Data Prep
I’m going to load the baseline data from the baseline analysis. The report and data can be found here. I’ll load the new data directly from CommCare. The original baseline data object was d but I’m going to make it b. Each subsequent round will be r1, r2 and so on.
Overall I want to bring in 3 data sources:
- Basline survey data and soil data
- Round 1 survey and and soil data from 16B
- Round 1 yield and soil data - these data come from paired climbing bean harvest measurements and soil samples from 16B
- We can also look at maize paired yield and soil samples from 17A.
Baseline data
dataDir <- normalizePath(file.path("..", "..", "data"))
forceUpdateAll <- FALSE
baselineDir <- normalizePath(file.path("..", "rw_baseline", "data"))
load(file=paste0(baselineDir, "/shs rw baseline full soil.Rdata")) # obj d
b <- baseVars
Context point: The baseline data has 2439 rows. This is 9 fewer rows than we expected in the baseline. This is because of some farmers not being surveyed as expected. See the baseline report for more details. Also, these baesline values have te
Alex Villec wrote a cleaning script to deal with the first round of Rwanda SHS follow up data and make key adjustments to the data. To utilize that do file here, I’m going to download the data from Commcare, save it, and have the dofile access that file to execute. However, the original file Alex was using had different variable names than the file pulled by the API. The options from here are to just go with the file from Alex or to align the variable names between his version and the CC version. It’s valuable to have the data directly from CC but it’ll involve more work up front
Round 1 data
source("../oaflib/commcareExport.R")
r <- getFormData("oafrwanda", "M&E", "16B Ubutaka (Soil)", forceUpdate = forceUpdateAll)
[1] "found fdd434a62c6512b320a4cb8c4fb872a"
write.csv(r, file="rawCcR1Data.csv", row.names = F)
The first round of data from CommCare has 2380 observations. This leaves XX number of farmers unsurveyed in the first survey round. See this cleaning file for more information on the farmers we did not find again in the first follow up.
Here I’m going to call the STATA cleaning file to make AV’s changes to the R1 follow up data. This requires that the data from CC have the same variable names as the STATA cleaning file. I’m going to try to execute that here:
stataDir <- normalizePath(file.path("..", "rw_round_1_check"))
Here I access the soil predictions from the OAF soil lab. Patrick Bell manages the lab and Mike Barber oversees the prediction scripts.
soilDir <- normalizePath(file.path("..", "..", "OAF Soil Lab Folder", "Projects", "rw_shs_second_round", "4_predicted", "other_summaries"))
soil <- read.csv(file=paste(soilDir, "combined-predictions-including-bad-ones.csv", sep = "/"))
idDir <- normalizePath(file.path("..", "..", "OAF Soil Lab Folder", "Projects", "rw_shs_second_round", "5_merged"))
Identifiers <- read_excel(paste(idDir,"database.xlsx",sep="/"), sheet=1)
Combine the available data by farmer and resolve merging issues. These data can be combined long as long as the variable names are consistent or wide. I’m going to combine the data long and use split type commands to aggregate the data more easily. Confirm the variable names are consistent. By advancing this code on 5/9/17, I’m for the time being ignoring the cleaning Alex did in his do file. I’ll need to go back and incorporate those changes.
TODO: see if the variables names in Alex’s raw data, shared by Nathaniel, match the data I’m downloading from commcare. If so, don’t use the var_names.xlsx sheet and instead use those variable names and Alex’s do file to preserve all of his changes.
Not many of the names are the same. I’ve downloaded the meta data from CommCare which I’ll use to simplify the cleaning of the round 1 data. I’m also going to reshape the baseline variable names to simplify the matching of baseline variables to round 1 variables.
datNames <- function(dat){
varNames = names(dat)
exVal = do.call(rbind, lapply(varNames, function(x){
val = dat[1:3,x]
return(val)
}))
out = cbind(varNames, exVal)
return(out)
}
baseNames <- datNames(b)
write.csv(baseNames, file="baseline var names.csv", row.names = F)
Load Alex’s raw data and take the variable names from this. If I can align these variable names with the data from CC I can then execute Alex’s cleaning script on the CC data and proceed with combining the data
Stata .do file
rawDir <- normalizePath(file.path("Soil health study (year one)", "data"))
avRaw <- read.csv(paste(rawDir, "y1_shs_rwanda_28sep.csv", sep = "/"), stringsAsFactors = F)
It looks like the data from CommCare aligns with the raw data Alex worked with at info_formid which is the second index for avRaw and the 10th index for r. Let’s just try transferring them over and the work of updating the variable names through the CC codebook export may not be necessary!
varTest <- data.frame(fromcc = names(r)[10:409], fromav = names(avRaw)[2:401])
# head(varTest)
# tail(varTest)
#varTest[90:120,]
write.csv(varTest, file="variableNameCheck.csv")
It seems to line up okay (with some adjustments)! To incorporate Alex’s cleaning code I have to export the data from R to a form Stata accept, run the code, and then load the data back in.
This function will remove all strange outputs from the data from CommCare so that the STATA code works
charClean <- function(df){
df <- as.data.frame(lapply(df, function(x){
x = gsub("'", '', x)
x = gsub("^b", '', x)
x = ifelse(grepl("map object", x)==T, NA, x)
return(x)
}))
return(df)
}
r <- charClean(r)
Here is where I actually update the names in r to match Alex’s original data.
names(r)[10:409] <- names(avRaw)[2:401]
#export so stata can run - check for variable names longer than 32char
table(nchar(names(r)))
2 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 32 33 34 36
1 4 3 1 1 2 6 1 1 2 3 5 17 11 16 12 5 8 1 7 1 3 9 9 3 7 2 3 1 28
37 38 39 40 41 42 43 44 45 46 47 48 49 51 52
16 47 32 11 7 27 18 21 31 10 7 4 3 1 1
write.csv(r, file="toBeCleanedStata.csv", row.names = F)
stata("cleans_y1_shs_rwanda.do", stata.echo=F)
Now load the result of the Stata file
r <- read.csv("cleanedforR.csv", stringsAsFactors = F)
Cleaning
The r dataframe has many more variables than the baseline survey. This was in part expected; we added questions to the first follow up round based on lessons from the baseline. It’s also due to how the survey was set up in CommCare. Before combining the baseline and the first follow up round I need to:
- reshape the round 1 variables so that they appropriately match the baseline variables
- Clean those variales or prepare them as need be for a
- For variables with no match, clean
Drop variables
toDrop <- c("appformid", "id", "domain", "metadatadeviceid")
r <- r[,!names(r) %in% toDrop]
source("../oaflib/misc.R")
names(r) <- gsub("^y1_|intro_", "", names(r))
r[r=="."] <- NA
r <- divideGps(r, "gps_coord")
Categorical variables
The responses of the categorical variables should be regulated through CC, however, to check, make a table that shows the top ten responses in descending order and make a graph of response counts to know what to check. I’ll then capture any characters that should be numeric and convert them.
catVars <- names(r)[sapply(r, function(x){
is.character(x)
})]
enumClean <- function(dat, x, toRemove){
dat[,x] <- ifelse(dat[,x] %in% toRemove, NA, dat[,x])
return(dat[,x])
}
strTable <- function(dat, x){
varName = x
tab = as.data.frame(table(dat[,x], useNA = 'ifany'))
tab = tab[order(tab$Freq, decreasing = T),]
end = ifelse(length(tab$Var1)<10, length(tab$Var1), 10)
repOrder = paste(tab$Var1[1:end], collapse=", ")
out = data.frame(variable = varName,
responses = repOrder)
return(out)
}
# clean up known values
catEnumVals <- c("-99", "-88", "- 99", "-99.0", "88", "_88", "- 88", "0.88",
"--88", "__88", "-88.0", "99.0")
r[,catVars] <- sapply(catVars, function(y){
r[,y] <- enumClean(r,y, catEnumVals)
})
responseTable <- do.call(rbind, lapply(catVars, function(x){
strTable(r, x)
}))
Categorical response table
A simple table to preview the values in the data. The values are ranked by frequency.
kable(responseTable)
|
variable
|
responses
|
|
metadatauserid
|
c3e5e4d69726a6587d9d5739f3961b03, ab7675956342e27f3a134b45731ca6f9, a8f48eb2ccc435935cdefec31a49f512, 2da910f9aa814b352b62821db7ac30fc, 7e1b7bc7a7147b9f4ddfedab54e8e470, 43ab9369b7e43edaa7d9614594f4d1dd, 9938a37f596038d85181e4d38cff2433, bfb7f31368600aefe2c4386ad49c5126, 4a69416450e53b6e762ea707aaf80104, 089ae26df7d5ea3886dbbe3709c34013
|
|
metadatausername
|
umushakashatsi, umushakashatsi3, umushakashatsi72, umushakashatsi42, umushakashatsi58, umushakashatsi14, umushakashatsi66, umushakashatsi7, umushakashatsi13, umushakashatsi73
|
|
metadatatimestart
|
2012-01-01T02:07:31.468000, 2012-01-01T21:53:26.687000, 2012-01-01T23:04:56.746000, 2012-01-06T20:14:52.707000, 2012-01-06T21:14:58.517000, 2012-01-07T01:08:44.167000, 2016-07-27T07:53:43.734000, 2016-07-27T08:39:53.902000, 2016-07-27T08:39:57.777000, 2016-07-27T08:41:57.353000
|
|
metadatatimeend
|
2012-01-06T20:52:59.887000, 2012-01-07T19:01:49.301000, 2012-01-07T19:04:31.323000, 2012-01-07T19:09:38.384000, 2016-07-27T09:41:47.415000, 2016-07-27T09:57:48.152000, 2016-07-27T10:43:47.085000, 2016-07-27T11:24:53.338000, 2016-07-27T11:25:03.144000, 2016-07-27T11:26:55.594000
|
|
start_time
|
09:00:00.000+02, 08:30:00.000+02, 09:40:00.000+02, 10:13:00.000+02, 10:36:00.000+02, 12:20:00.000+02, 09:14:00.000+02, 09:29:00.000+02, 10:14:00.000+02, 10:56:00.000+02
|
|
date
|
2016-08-10, 2016-08-11, 2016-08-08, 2016-08-17, 2016-08-03, 2016-08-18, 2016-08-22, 2016-08-19, 2016-08-04, 2016-08-12
|
|
enum_name
|
Hagenimana bienvenue, MUCYOWIMIHIGO J MV, Nyandwi Anathalie, ZIMUKWIYE Dominique, Nyirangirimana jeanne, Torero pacifique, Utamuriza Jeanne, Niyidufasha nathanael, Rukundo japhet, NYIRAMPANO Bernadette
|
|
photo
|
, 1325376816129.jpg, 1325447804135.jpg, 1325452024080.jpg, 1325873951716.jpg, 1325877535600.jpg, 1325891580194.jpg, 1469601919598.jpg, 1469601990645.jpg, 1469602247216.jpg
|
|
district
|
Rutsiro, Karongi, Mugonero, Nyamasheke, Huye, Rwamagana, Gatsibo_NLWH, Gatsibo_LWH, Nyamagabe, Kayonza
|
|
cell_field
|
Rubumba, Mubuga, Nyabicwamba, NYAGATARE, Mugera, MutongoCA, Bihumbe, Busetsa, Gihumuza, Kibyagira A
|
|
village
|
Gasharu, Murambi, Rugarama, Kabeza, Karambo, Kigarama, Nyabugogo, Kabuga, Kivumu, Gasagara
|
|
farmer_list
|
Havugimana celestin, Karekezi Celestin, Mukabinyange cecile, Mukafundi Marie, Musabyimana Jean, Ndananiwe Francois, Ndayambaje Emmanuel, Nsengiyumva Augustin, Nyirahabimana seraphine, Nyiraminani Constasie
|
|
farmer_respond
|
NA, Akimana Jeannette, BIMENYANDE Djumapri, Habimana Emmanuel, Hagumagatsi Gaspard, Karekezi Celestin, Mukabinyange cecile, Mukangiriye Donatha, Mukankusi Beatrice, MUNYENSANGA Emmanuel
|
|
farmer_phonenumber
|
NA, Ntayo, 0, ntayo, Nta telephone afite, Ntayo afite, 0.0, -, nta telephone afite, Ntayo bafite
|
|
d_phone
|
NA, 0, Ntayo, ntayo, Ni wewabajijwe, -, Ntayo afite, O, Nta telephone afite, Ntayo bafite
|
|
neighbor_phonenumber
|
NA, ntayo, 0, Ntayo, 0.0, -, 0789699430, 0785275883, 7.85275883E8, 0723071668
|
|
gender
|
female, male
|
|
n_tubura_season
|
not_a_client_3seasons, 16a 16b 17a, 16a 17a, 17a, 16a 16b, 16a, NA, 16b 17a, 16b, 16a not_a_client_3seasons
|
|
which_crop_16a_1
|
gor
|
|
which_maize_seed_16a_1
|
NA, gor_nsp, new_hybrid, OPV_saved, Hybride_saved, OPV_new
|
|
which_crop_16a_2
|
NA, yum, gor, big, insina, jum, soya, ray, shy, shaz
|
|
which_maize_seed_16a_2
|
NA, gor_nsp, Hybride, OPV_saved, OPV_new, Hybride_saved
|
|
fert_type1_16a
|
None, DAP, NA, NPK-17, urea, NPK-22, npk2555
|
|
fert_type2_16a
|
NA, urea, None, DAP, NPK-17, NPK-22, npk2555
|
|
quality_compost_16a
|
Good, NA, Average, Bad
|
|
type_compost_16a
|
cow, NA, goat, pig, other, plant, kitchen_waste, human, chicken
|
|
d_lime_16a
|
no_lime, NA, lime_outside, lime_tubura, both_tubura_non_tubura
|
|
which_crop_16b_1
|
big, shy, saka, NA, jum, soya, gor, ray, nyo, yum
|
|
which_maize_seed_16b_1
|
NA, new_hybrid, gor_nsp, OPV_new, Hybride_saved, OPV_saved
|
|
which_crop_16b_2
|
NA, gor, yum, jum, insina, big, soya, saka, shy, ray
|
|
which_maize_seed_16b_2
|
NA, new_hybrid, OPV_new, gor_nsp, Hybride_saved, OPV_saved
|
|
fert_type1_16b
|
None, NA, DAP, NPK-17, urea, NPK-22, npk2555
|
|
fert_type2_16b
|
NA, None, urea, DAP, NPK-17
|
|
quality_compost_16b
|
NA, Good, Average, Bad
|
|
type_compost_16b
|
NA, cow, pig, goat, kitchen_waste, plant, human, other, chicken
|
|
d_lime_16b
|
no_lime, NA, lime_outside, lime_tubura
|
|
how_use_residues
|
feed_animals, mulching, leave_field, compost_use, burn_field, burn_discard, sell
|
|
field_texture
|
clay_loam, loam, silty_clay_loam, sandy_clay_loam, sandy_loam, silty_loam, silty_clay, loamy_sand, sand, clay
|
|
field_erosion
|
drainageditch, nothing, radicalterrace, gradualterrace
|
|
crop_direction
|
not_applicable, NA, across_slope, down_slope
|
|
comments
|
, Ntakibazo, ntakibazo, ntayo, Ntayo, Ntazo, ntazo, Ntakibazo., Ntacyahindutse, NA
|
|
sample_id
|
12, 137, 1503, 2044C, 2278, 2299, 2610, 2612, 2612C, 10
|
|
kg_yield_hwag_16b_1
|
NA
|
|
kg_seed_ananas_16b_2
|
NA
|
|
kg_seed_veg_16a_1
|
NA
|
|
kg_seed_16a_1
|
N, 1, 0, 2, -, 3, 4, 5, 6, 8
|
|
kg_seed_16a_2
|
, NA, 0.5, 1.0, 0.25, 2.0, 3.0, 1.5, 4.0, 5.0
|
|
kg_seed_16b_1
|
NA, , 3.0, 2.0, 1.0, 0.5, 1.5, 4.0, 5.0, 6.0
|
|
kg_seed_16b_2
|
, NA, 0.5, 1.0, 0.25, 2.0, 1.5, 3.0, 4.0, 5.0
|
|
kg_yield_16a_1
|
NA, 50.0, 20.0, 100.0, 30.0, 10.0, 40.0, 15.0, 200.0, 5.0
|
|
kg_yield_16a_2
|
, NA, 20.0, 10.0, 50.0, 30.0, 0.0, 15.0, 5.0, 100.0
|
|
kg_yield_16b_1
|
, NA, 20.0, 30.0, 10.0, 15.0, 5.0, 50.0, 40.0, 100.0
|
|
kg_yield_16b_2
|
, NA, 0.0, 10.0, 5.0, 20.0, 15.0, 3.0, 40.0, 50.0
|
|
gps_coord
|
NA, , -1.5578864555610237 30.39436791689242 1525.93 15.0, -1.5631940702424174 30.227211802604916 1659.67 15.0, -1.5639320092237632 30.227385933820276 1434.79 10.0, -1.5667398240763533 30.273551799148027 979.26 10.0, -1.567033053159622 30.277914044142907 982.39 10.0, -1.5671285398447943 30.275353919885177 560.94 10.0, -1.5685424850437755 30.248542080122405 1468.14 20.0, -1.5688621725334673 30.24841864727349 851.74 10.0
|
|
unique_location
|
Gatsibo_NLWH2610, Gatsibo_NLWH2612, Gatsibo_NLWH2612C, Huye137, Karongi1503, Rutsiro2044C, Rutsiro2278, Rutsiro2299, Gatsibo_LWH2476, Gatsibo_LWH2476C
|
Categorical response graphs
repGraphs <- function(dat, x){
tab = as.data.frame(table(dat[,x], useNA = 'ifany'))
tab = tab[order(tab$Freq, decreasing = T),]
print(
ggplot(data=tab, aes(x=Var1, y=Freq)) + geom_bar(stat="identity") +
theme(legend.position = "bottom", axis.text.x = element_text(angle = 45, hjust = 1)) +
labs(title =paste0("Composition of variable: ", x))
)
}
adminVars <- c(names(r)[grep("meta", names(r))], "start_time", "enum_name", "photo", "cell_field", "village", "farmer_respond", "farmer_phonenumber", "d_phone", "neighbor_phonenumber", "farmer_list", "unique_location", "comments", "gps_coord", "sample_id", "SSN")
nonAdminVars <- catVars[!catVars %in% adminVars]
for(i in 1:length(nonAdminVars)){
repGraphs(r, nonAdminVars[i])
}





































Manual character cleaning
r$female <- ifelse(r$gender=="female", 1, 0)
r$district <- ifelse(grepl("nyanza", r$district)==T, "Nyanza", r$district)
#table(r$kg_seed_16b_1)
#table(r$kg_yield_16a_2)
strtoNum <- c("kg_seed_16b_1", "kg_yield_16a_1", "kg_yield_16b_1", "kg_yield_16b_2")
r[,strtoNum] <- sapply(r[,strtoNum], function(x){as.numeric(x)})
Categorical cleaning
TODO here!
Notes on the categorical variables:
- We don’t have many actual responses on seed type despite all farmers telling us about a crop they are growing. Why? Check that there wasn’t a mislabeling of variables.
- Check the ‘which_maize_seed’ variables to make certain they’re flexible to the type of crop selected in the previous question.
- Confirm that blank is NA not 0.
Numeric variables
numVars <- names(r)[sapply(r, function(x){
is.numeric(x)
})]
Basic cleaning of known issues like enumerator codes for DK, NWR, etc.
enumVals <- c(-88,-85, -99)
r[,numVars] <- sapply(numVars, function(y){
r[,y] <- enumClean(r,y, enumVals)
})
Numeric outlier table
iqr.check <- function(dat, x) {
q1 = summary(dat[,x])[[2]]
q3 = summary(dat[,x])[[5]]
iqr = q3-q1
mark = ifelse(dat[,x] < (q1 - (1.5*iqr)) | dat[,x] > (q3 + (1.5*iqr)), 1,0)
tab = rbind(
summary(dat[,x]),
summary(dat[mark==0, x])
)
return(tab)
}
# remove admin vars
numAdminVars <- c(numVars[1:3])
numVarsNotAdmin <- numVars[!numVars %in% numAdminVars]
iqrTab <- do.call(plyr::rbind.fill, lapply(numVarsNotAdmin, function(y){
#print(y)
res = iqr.check(r, y)
#print(dim(res))
out = data.frame(var=rbind(y, paste(y, ".iqr", sep="")), res)
return(out)
}))
iqrTab[,2:8] <- sapply(iqrTab[,2:8], function(x){round(x,1)})
The outlier table summarizes the numeric variables with and without IQR outliers to show how the data changes based on this filter.
knitr::kable(iqrTab, row.names = F, digits = 0, format = 'markdown')
| d_client_16b |
0 |
0 |
0 |
0 |
1 |
1 |
NA |
| d_client_16b.iqr |
0 |
0 |
0 |
0 |
1 |
1 |
NA |
| d_client_17a |
0 |
0 |
0 |
0 |
1 |
1 |
NA |
| d_client_17a.iqr |
0 |
0 |
0 |
0 |
1 |
1 |
NA |
| age |
16 |
35 |
45 |
47 |
57 |
90 |
NA |
| age.iqr |
16 |
35 |
45 |
47 |
57 |
90 |
NA |
| n_household |
0 |
4 |
5 |
5 |
7 |
39 |
NA |
| n_household.iqr |
0 |
4 |
5 |
5 |
7 |
11 |
NA |
| n_cows |
0 |
0 |
1 |
1 |
1 |
15 |
NA |
| n_cows.iqr |
0 |
0 |
1 |
1 |
1 |
2 |
NA |
| n_goats |
0 |
0 |
0 |
1 |
2 |
18 |
NA |
| n_goats.iqr |
0 |
0 |
0 |
1 |
2 |
5 |
NA |
| n_chickens |
0 |
0 |
0 |
1 |
1 |
40 |
NA |
| n_chickens.iqr |
0 |
0 |
0 |
0 |
0 |
2 |
NA |
| n_pigs |
0 |
0 |
0 |
0 |
1 |
11 |
NA |
| n_pigs.iqr |
0 |
0 |
0 |
0 |
1 |
2 |
NA |
| n_sheep |
0 |
0 |
0 |
0 |
0 |
35 |
NA |
| n_sheep.iqr |
0 |
0 |
0 |
0 |
0 |
0 |
NA |
| field_length |
0 |
13 |
20 |
26 |
32 |
214 |
NA |
| field_length.iqr |
0 |
13 |
20 |
23 |
30 |
60 |
NA |
| field_width |
0 |
12 |
20 |
24 |
31 |
160 |
NA |
| field_width.iqr |
0 |
12 |
20 |
22 |
30 |
59 |
NA |
| n_spots |
3 |
3 |
3 |
4 |
5 |
5 |
NA |
| n_spots.iqr |
3 |
3 |
3 |
4 |
5 |
5 |
NA |
| fert_kg1_16a |
0 |
1 |
2 |
4 |
5 |
80 |
1408 |
| fert_kg1_16a.iqr |
0 |
1 |
2 |
3 |
4 |
11 |
1408 |
| fert_kg2_16a |
0 |
0 |
0 |
2 |
2 |
200 |
1198 |
| fert_kg2_16a.iqr |
0 |
0 |
0 |
1 |
2 |
5 |
1198 |
| d_compost_16a |
0 |
1 |
1 |
1 |
1 |
1 |
271 |
| d_compost_16a.iqr |
1 |
1 |
1 |
1 |
1 |
1 |
271 |
| kg_compost_16a |
0 |
100 |
200 |
268 |
300 |
20000 |
613 |
| kg_compost_16a.iqr |
0 |
100 |
191 |
205 |
300 |
600 |
613 |
| kg_lime_16a |
0 |
15 |
40 |
66 |
100 |
500 |
2345 |
| kg_lime_16a.iqr |
0 |
10 |
25 |
52 |
100 |
150 |
2345 |
| fert_kg1_16b |
0 |
1 |
2 |
4 |
4 |
100 |
1964 |
| fert_kg1_16b.iqr |
0 |
1 |
2 |
2 |
3 |
8 |
1964 |
| fert_kg2_16b |
0 |
0 |
0 |
0 |
0 |
88 |
1656 |
| fert_kg2_16b.iqr |
0 |
0 |
0 |
0 |
0 |
0 |
1656 |
| d_compost_16b |
0 |
0 |
1 |
0 |
1 |
1 |
529 |
| d_compost_16b.iqr |
0 |
0 |
1 |
0 |
1 |
1 |
529 |
| kg_compost_16b |
0 |
100 |
160 |
238 |
300 |
10000 |
1411 |
| kg_compost_16b.iqr |
0 |
100 |
150 |
193 |
250 |
600 |
1411 |
| kg_lime_16b |
1 |
10 |
25 |
59 |
50 |
650 |
2353 |
| kg_lime_16b.iqr |
1 |
10 |
25 |
32 |
50 |
100 |
2353 |
| field_slope |
-5 |
3 |
6 |
9 |
14 |
60 |
NA |
| field_slope.iqr |
-5 |
3 |
6 |
9 |
14 |
30 |
NA |
| field_n_crops |
0 |
1 |
1 |
2 |
2 |
30 |
343 |
| field_n_crops.iqr |
0 |
1 |
1 |
1 |
2 |
3 |
343 |
| kg_seed_16b_1 |
0 |
1 |
2 |
5 |
4 |
500 |
754 |
| kg_seed_16b_1.iqr |
0 |
1 |
2 |
3 |
4 |
10 |
754 |
| kg_yield_16a_1 |
0 |
15 |
34 |
73 |
80 |
6000 |
1570 |
| kg_yield_16a_1.iqr |
0 |
12 |
30 |
41 |
50 |
170 |
1570 |
| kg_yield_16b_1 |
0 |
8 |
20 |
53 |
50 |
6000 |
600 |
| kg_yield_16b_1.iqr |
0 |
8 |
20 |
28 |
40 |
112 |
600 |
| kg_yield_16b_2 |
0 |
3 |
10 |
25 |
25 |
600 |
1954 |
| kg_yield_16b_2.iqr |
0 |
3 |
8 |
13 |
20 |
55 |
1954 |
| yield_compare_16a_1 |
1 |
1 |
1 |
2 |
3 |
3 |
1506 |
| yield_compare_16a_1.iqr |
1 |
1 |
1 |
2 |
3 |
3 |
1506 |
| yield_compare_16a_2 |
1 |
1 |
2 |
2 |
2 |
3 |
1355 |
| yield_compare_16a_2.iqr |
1 |
1 |
2 |
2 |
2 |
3 |
1355 |
| yield_compare_16b_1 |
1 |
1 |
1 |
2 |
2 |
3 |
358 |
| yield_compare_16b_1.iqr |
1 |
1 |
1 |
2 |
2 |
3 |
358 |
| yield_compare_16b_2 |
1 |
1 |
1 |
2 |
2 |
3 |
1734 |
| yield_compare_16b_2.iqr |
1 |
1 |
1 |
2 |
2 |
3 |
1734 |
| lat |
-3 |
-2 |
-2 |
-2 |
-2 |
-2 |
497 |
| lat.iqr |
-3 |
-2 |
-2 |
-2 |
-2 |
-2 |
497 |
| lon |
29 |
29 |
30 |
30 |
30 |
31 |
497 |
| lon.iqr |
29 |
29 |
30 |
30 |
30 |
31 |
497 |
| alt |
-108 |
1513 |
1673 |
1668 |
1887 |
2668 |
497 |
| alt.iqr |
957 |
1541 |
1680 |
1728 |
1887 |
2430 |
497 |
| precision |
5 |
10 |
15 |
19 |
15 |
4181 |
497 |
| precision.iqr |
5 |
10 |
15 |
13 |
15 |
20 |
497 |
| female |
0 |
0 |
1 |
1 |
1 |
1 |
NA |
| female.iqr |
0 |
0 |
1 |
1 |
1 |
1 |
NA |
Outlier Graphs
# http://rforpublichealth.blogspot.com/2014/02/ggplot2-cheatsheet-for-visualizing.html
for(i in 1:length(numVarsNotAdmin)){
base <- ggplot(r, aes(x=r[,numVarsNotAdmin[i]])) + labs(x = numVarsNotAdmin[i])
temp1 <- base + geom_density()
temp2 <- base + geom_histogram()
#temp2 <- boxplot(r[,numVars[i]],main=paste0("Variable: ", numVars[i]))
multiplot(temp1, temp2, cols = 2)
}





































Numeric variable cleaning
TODO here!
Merge in soil data
First merge the soil data with the identifiers as we should get full matches. Then merge soil data to the survey data
Identifiers <- Identifiers %>% rename(
sample_id = `Sample ID`,
SSN = `Lab ssn`
) %>% mutate(
sample_id = gsub(" ", "", tolower(sample_id))
)
table(Identifiers$SSN %in% soil$SSN) # full matches
TRUE
2426
soil <- left_join(soil, Identifiers[, c("SSN", "sample_id")], by="SSN")
We have some surveys that don’t have soil data. It seems the soil sample id in the Identifiers data are a bit messy. Let’s clean both up above by removing spaces and making lower case.
r$sample_id <- tolower(r$sample_id)
table(r$sample_id %in% soil$sample_id)
FALSE TRUE
28 2366
r$sample_id[!r$sample_id %in% soil$sample_id]
[1] "1062c" "1198c" "1212" "1228" "1242" "1380c" "1384c" "1626c" "204" "2042c" "2175"
[12] "2415" "2418" "2418c" "2426" "2426c" "2534" "2561c" "2636c" "2671c" "2696" "2741"
[23] "2819" "2979" "596c" "65c" "66c" "931"
write.csv(r$sample_id[!r$sample_id %in% soil$sample_id], "surveysWoSoil.csv", row.names = F)
And some soil sample_id that don’t have a survey
soil$sample_id[!soil$sample_id %in% r$sample_id]
[1] "137c" "569c" "902" "902c" "903" "903c" "904" "904c" "909" "909c" "912"
[12] "912c" "931c" "946" "946c" "947" "947c" "953" "953c" "954" "954c" "962"
[23] "962c" "964" "966c" "967" "968c" "969c" "970" "970c" "971" "971c" "973"
[34] "975" "975c" "1061c" "1062" "1096" "1096c" "1102" "1102c" "1103" "1103c" "1105"
[45] "1105c" "1159" "1159c" "1162c" "1203" "1359" "1372" "1432c" "1437" "1501" "1503c"
[56] "1538" "2215" "2204" "2350c" "2355" "2368" "2625c" "956c" "2685c" "2819c" "2634"
[67] "2850c" "1189c"
write.csv(soil$sample_id[!soil$sample_id %in% r$sample_id], "soilsWoSurvey.csv", row.names = F)
dim(r)
[1] 2394 93
r <- left_join(r, soil, by="sample_id")
dim(r) # why is it one row longer after the left_join?
[1] 2395 115
Soil values
ggplot(r, aes(x=Calcium, y=Magnesium)) + geom_point() +
stat_smooth(method="loess") +
labs(x = "Calcium (m3)", y= "Magnesium (m3)", title="Calcium and Magnesium relationship")

ggplot(r, aes(x=pH, y=Calcium)) + geom_point() +
stat_smooth(method="loess") +
labs(x = "pH", y="Calcium (m3)", title = "pH and Calcium relationship")

ggplot(r, aes(x=pH, y=Magnesium)) + geom_point() +
stat_smooth(method="loess") +
labs(x = "pH", y="Magnesium (m3)", title = "pH and Magnesium relationship")

ggplot(r, aes(x=pH, y=X.Exchangeable.Acidity)) + geom_point() +
stat_smooth(method="loess") +
labs(x = "pH", y="Exchangeable Aluminum", title = "pH and Aluminum relationship")

ggplot(r, aes(x=X.Organic.Carbon, y=X.Total.Nitrogen)) + geom_point() +
stat_smooth(method="loess") +
labs(x = "Total Carbon", y="Total Nitrogen", title = "Carbon and Nitrogen relationship")

soilVars <- names(r)[which(names(r)=="pH"):which(names(r)=="X.Total.Nitrogen")]
keySoilVars <- c("pH", "X.Organic.Carbon", "X.Total.Nitrogen", "Calcium", "Magnesium")
write.csv(soilVars, file="soilVarsforStep.csv", row.names = F)
Initial T vs. C soil comparison
Please note: These are raw comparisons using only round 1 data and thus should not be taken as initial findings for how T and C farmers compare. Farmers will be matched to ensure a proper comparison.
for(i in 1:length(soilVars)){
p1 <- ggplot(data=r, aes(x=as.factor(d_client_16b), y=r[,soilVars[i]])) +
geom_boxplot() +
labs(x="Tubura Farmer", y=soilVars[i])
p2 <- ggplot(data=r, aes(x=r[,soilVars[i]])) +
geom_density() +
labs(x=soilVars[i])
multiplot(p1, p2, cols=2)
}



















Soil notes for Patrick and Step
- The carbon vs. nitrogen scatter plot looks odd in that the values are clumped in discrete lines. Why might that be?
- What are appropriate cutoff values for the lab predictions? (Patrick, as a general question, we should probably apply those cutoffs to any lab data before sharing it with the teams to simplify working with those data)
Soil value cleaning
Step and Patrick say that it’s hard to set hard and fast guidelines for what are and are not reasonable values. I’m therefore going to see what happens to the data if we trim by sd and IQR and then apply one of those adjustments to the data.
check.3sd <- function(x) {
x = ifelse(is.infinite(x), NA, x)
mean = mean(x, na.rm=T)
sd = sd(x, na.rm=T)
mark = ifelse(x>(mean + (3*sd)) |
x<(mean - (3*sd)), NA, x)
return(mark)
}
sdSoilVals <- r %>%
dplyr::select(pH:X.Total.Nitrogen)
sdCheck <- as.data.frame(apply(sdSoilVals, 2, function(x){
return(check.3sd(x))
}))
for(i in 1:length(soilVars)){
print(ggplot(data=sdCheck, aes(x=sdCheck[,soilVars[i]])) +
geom_density() +
labs(x=soilVars[i])
)
}



















Important note: I’m going to add the adjusted values to the r data frame giving the previous variables the extension .raw so I can distinguish between the original and modified data.
names(r)[which(names(r)=="pH"):which(names(r)=="X.Total.Nitrogen")] <- paste0(names(r)[which(names(r)=="pH"):which(names(r)=="X.Total.Nitrogen")], ".raw")
r <- cbind(r, sdCheck)
Check for unique ids
I’m seeing that there are duplicated farmers in the data when I’m trying to reshape the r data from wide to long. Let’s check them out here and see if we can figure out which observation is right.
- Check Alex’s do file to see if there’s mention of these farmers. [No mention]
- Check the baseline values as these should line up.
length(r$sample_id)==length(unique(r$sample_id))
[1] FALSE
dups <- r$sample_id[duplicated(r$sample_id)]
dupIndex <- which(duplicated(r$sample_id))
#dupDat <- r[r$sample_id %in% dups,]
#head(r[r$sample_id==dups[1],])
#head(r[r$sample_id==dups[2],])
Let’s solve the unique id issue by looking at identifying information in the baseline data
roundId <- r %>%
dplyr::select(district, cell_field, village, sample_id, farmer_list) %>%
filter(r$sample_id %in% dups)
#d
load("rawBaselineWithIdentifers.Rdata")
baseId <- d %>%
dplyr::select(district, selected_cell, umudugudu, sample_id, farmer_name ) %>%
filter(d$sample_id %in% dups)
#baseId
#roundId
Correct duplicates
Correct the duplicates I can and drop the others for now. Flag the duplicated ones and save them to share with Nathaniel.
TODO(mattlowes) - share any remaining duplicates with Nathaniel and see if he has a solution. Also see if he can understand why this might have happened and if they should actually have a different sample id.
- share the merged data for Nathaniel to put into CC (include the duplicate ids)
r <- r %>% mutate(
dup = ifelse(
sample_id == "12" & cell_field == "MUNANIRA" |
sample_id == "137" & village == "Rusuma" |
sample_id == "1503" & farmer_list=="NAKAGIZE Val\\xc3\\xa9rie" |
#sample_id == "2044C" & # same!
sample_id == "2278" & cell_field=="Nkira A" | # check this as maybe this was the only thing wrong?
#sample_id == "2299" & # same!
sample_id == "2610" & village=="agakiri" #| #agakiri is close to gakiri in spelling. Is this just a typo?
#sample_id == "2612" & # same names!
#sample_id == "2612C" # same names!
, 1, 0)
) %>% filter(
dup!=1
) %>% dplyr::select(-dup)
# run this code again from above to get updated duplicates list
#length(r$sample_id)==length(unique(r$sample_id))
dups <- r$sample_id[duplicated(r$sample_id)]
dupIndex <- which(duplicated(r$sample_id))
# for the time being drop the observations that are duplicates
r <- r[!r$sample_id %in% dups,]
Reshape variables
This should include the baseline variables as well.
Let’s first check with the baseline data to see what variables we made there so I can make the same ones from the round 1 data. There are some variables that are baseline variables only like variables asking about historical practices. There are then other variables that will vary by season. These are the variables that we ultimately want in to shape in a long dataset by season to analyze changes overtime in practices and soil management. I think this will result in a dataset that has one row per farmer per season. Some variables may not fit nicely into this but we can deal with those. For variables that aren’t changing over time they’ll show as not important in our model. They’re important for matching farmers.
There are a lot of variables to try to line up. Some already have the same name but how to best combine the ones that have different variable names? I’m going to write a function that takes a variable name from b and a variable name from r that should go together, updates the r variable name and uses that info to rbind the data into a long dataset.
# names(b)
# names(r)
# check the names that already match
baselineFound <- names(b)[names(b) %in% names(r)] # not many variable names are aligned
Update variable names so that any variable with 16a or 16b has a the a or b season designation at the end it so I can replicate the gather() and spread() options for reorganizing the data by season and by plot. This means that the variable names will retain their designation of first or second application and be distinguishable.
TODO(mattlowes) - rename the variables according to that convention to reshape the r data. Keep the baseline data in mind as we’ll want to do the same thing with the baseline data to make them match.
r <- r %>% rename(
which_crop_1_16a = which_crop_16a_1,
which_maize_seed_1_16a = which_maize_seed_16a_1,
which_crop_2_16a = which_crop_16a_2,
which_maize_seed_2_16a = which_maize_seed_16a_2,
kg_seed_veg_1_16a = kg_seed_veg_16a_1,
kg_seed_1_16a = kg_seed_16a_1,
kg_seed_2_16a = kg_seed_16a_2,
kg_yield_1_16a = kg_yield_16a_1,
kg_yield_2_16a = kg_yield_16a_2,
yield_compare_1_16a = yield_compare_16a_1,
yield_compare_2_16a = yield_compare_16a_2,
which_crop_1_16b = which_crop_16b_1,
which_maize_seed_1_16b = which_maize_seed_16b_1,
which_crop_2_16b = which_crop_16b_2,
which_maize_seed_2_16b = which_maize_seed_16b_2,
#kg_seed_veg_1_16a = kg_seed_veg_16a_1,
#kg_seed_ananas_2_16a = kg_seed_ananas_16a_2,
#kg_seed_hwag_1_16a = kg_seed_hwag_16a_1,
kg_seed_1_16b = kg_seed_16b_1,
kg_seed_2_16b = kg_seed_16b_2,
kg_yield_1_16b = kg_yield_16b_1,
kg_yield_2_16b = kg_yield_16b_2,
yield_compare_1_16b = yield_compare_16b_1,
yield_compare_2_16b = yield_compare_16b_2
)
aSeason <- names(r)[grep("(1.a)", names(r))]
bSeason <- names(r)[grep("(1.b)", names(r))]
seasonalVars <- c(aSeason, bSeason, "sample_id")
farmerVars <- c(names(r)[!names(r) %in% seasonalVars], "sample_id")
# example data
# df <- data.frame(
# id = 1:10,
# time = as.Date('2009-01-01') + 0:9,
# Q3.2.1. = rnorm(10, 0, 1),
# Q3.2.2. = rnorm(10, 0, 1),
# Q3.2.3. = rnorm(10, 0, 1),
# Q3.3.1. = rnorm(10, 0, 1),
# Q3.3.2. = rnorm(10, 0, 1),
# Q3.3.3. = rnorm(10, 0, 1)
# )
#
# df %>%
# gather(key, value, -id, -time) %>%
# extract(key, c("question", "loop_number"), "(Q.\\..)\\.(.)") %>%
# spread(question, value)
# aDat <- r[,names(r) %in% aSeason] # works for this too!
# aDat <- aDat[,grep("16a_1", names(aDat))] # works for this
aDat <- r[,names(r) %in% seasonalVars] # works for this!
#http://stackoverflow.com/questions/25925556/gather-multiple-sets-of-columns
seasonalDat <- aDat %>%
gather(key, value, -sample_id) %>%
tidyr::extract(key, c("variable", "season"), "(^.*\\_1.)(.)") %>%
mutate(season = paste0("16", season)) %>%
spread(variable, value)
names(seasonalDat) <- gsub("_16", "", names(seasonalDat))
TODO(mattlowes) - confirm that the tidyr process worked as I expected as there are numerous missing values. These seem to appear where the variable only had one version of the variable, _16, rather than a _16a and a _16b. Check out how this is handling variables with _17 instead of _16.
Merge seasonal and demographic data
rs <- left_join(seasonalDat, r[,c(names(r)[!names(r) %in% seasonalVars],"sample_id")], by="sample_id")
Combine long with baseline
The matchRounds function updates variable names across rounds and reports the index and new name of the variables. I can then take the first part of the list for dat1 and the second part for dat2.
Or just change baseline variable names manually. What’s the best way to do this? First reshape the baseline variables to be plot level as well with a season indicator.
TODO(matt.lowes) Confirm that this is necessary. If the baseline data only includes the previous season and the history then the reshape may not be necessary. All subsequent surveys asked about two seasons, the intervening season and the relevant season. Get your head around the baseline data again and act.
# b <- b %>% rename(
# inputuse_priord_fertilizer_15b = inputuse_15b_priord_fertilizer,
# inputuse_priorculture_15b_1 = inputuse_15b_priorculture_15b_1,
# inputuse_priord_intercrop_15b = inputuse_15b_priord_intercrop_15b,
# inputuse_priorculture_in_15b = inputuse_15b_priorculture_15b_in,
# crop1_seety_15b = crop1_15b_seedty,
# #v58
# crop1_yield_15b = crop1_15b_yield,
# crop1_yield__15b = crop1_15b_yield_,
# crop2_seedty_15b = crop2_15b_seedty,
# #63
# crop2_seedkg_15b = crop2_15b_seedkg,
# crop2_yield_16b = crop2_15b_yield,
# crop2_yield__15b = crop2_15b_yield_,
# field_fert_t_15b = field_15b_fert_t,
# #v69
# field_compost_qu_15b = field_compost_qu
# )
I think that all needs to be done is to add a season variable and rename the baseline variables to take off the _15b portion.
write.csv(names(b), "baselineVars.csv", row.names = T)
write.csv(names(rs), "round1Vars.csv", row.names = T)
names(b) <- gsub("_15b", "", names(b))
b$season <- "15b"
b <- b %>% rename(
crop1_local = v58,
crop2_local = v63,
field_fert_t_1 = field_fert_t,
field_fert_t_2 = v69
)
TODO - it also seems to the case that some of the seed type variables are mixed up in r and rs. See what the issue is. Each plot should have only one answer for those.
MAJOR TODO: confirm that I’m not duplicating the soil data by assigning it to both of the seasons we asked about in the follow up survey (I think I currently am 6/15/17). We want to account for field management in the intervening season but we don’t want to assume the soil outcome is the same for both seasons. Specifically, this means the 16a season
TODO - add the onlyR1 variables back into the data so we have field texture.
Note: the final long data by plot should have only one observation for stationary variables like slope or historical information
# i'm updating baseline names to match round 1 names.
bUpdate <- b %>%
mutate(
d_compost = ifelse(field_kg_compost > 0, 1, 0)
) %>%
rename(
tablet = demographicid_tablet,
village = umudugudu,
n_household = hhsize,
n_tubura_season = total.seasons,
field_length = field_dim1, # I'm assuming dim1 is length. it might not be. It might not matter.
field_width = field_dim2,
n_spots = n_spots_c,
kg_seed_1 = crop1_seedkg,
kg_seed_2 = crop2_seedkg,
fert_kg1 = field_kg_fert1,
fert_kg2 = field_kg_fert2,
kg_yield_1 = crop1_yield,
kg_yield_2 = crop2_yield,
kg_compost = field_kg_compost,
d_client = client,
cell_field = cellule_field,
fert_type1 = field_fert_t_1,
fert_type2 = field_fert_t_2,
X.Total.Nitrogen = Total.Nitrogen,
X.Sodium = Sodium,
X.Organic.Carbon = Organic.Carbon,
X.EC..Salts. = EC..Salts.,
X.C.E.C = C.E.C,
X.Exchangeable.Acidity = Exchangeable.Acidity,
X.Exchangeable.Aluminium = Exchangeable.Aluminium,
X.Phosphorus.Sorption.Index..PSI. = Acid.Saturation, # check that this is right
n_cows = betail_ownedn_inka,
n_goats = betail_ownedn_ihene,
n_chickens = betail_ownedn_inkoko,
n_pigs = betail_ownedn_ingurube,
n_sheep = betail_ownedn_intama,
date = demographicdate,
field_slope = general_field_infograde_hill,
field_erosion = general_field_infoantierosion_ef,
type_compost = field_type_compo,
quality_compost = field_compost_qu,
d_sample = sample,
enum_name = surveyor,
how_use_residues = action_cropresid
)
# biographical variales that apply to actions in the baseline before the study started
bioVars <- bUpdate %>% dplyr::select(
n_season_fert, nofert_why, n_season_compost, nocompost_why, n_season_lime, nolime_why,
n_season_fallow, n_seasons_leg_1, n_seasons_leg_2, aez, contains("d_season_listd_"),
contains("inputuse_prior")
)
bVars <- names(bUpdate)[!names(bUpdate) %in% names(bioVars)] # remove biographical vars
# organizational variables to be ignored
orgVars <- bUpdate %>%
dplyr::select(
fieldcollectiondate, datecollectedindistrict, datesenttohq, datereceivedathq,
processedathq_, packedforsendingtokenya_, datefinishedprocessing
)
bVars <- bVars[!bVars %in% names(orgVars)]
# variables that only appear in the round 1 data >> likely want to keep these and make them part of the "stable" identifying data
onlyR1 <- rs %>%
dplyr::select(
field_n_crops, crop_direction, field_texture, sample_id
)
r1Vars <- names(rs)[!names(rs) %in% names(onlyR1)]
# check what's already the same
matchNames <- r1Vars[r1Vars %in% bVars] # these are the matches we're getting
# matchNames
# check what isn't accounted for somehow
unmatchedB <- bVars[!bVars %in% r1Vars] # unmatched baseline minus demographic vars
unmatchedRs <- r1Vars[!r1Vars %in% bVars] # unmatched r1
Make the sample id lower case
bUpdate$sample_id <- tolower(bUpdate$sample_id)
rs$sample_id <- tolower(rs$sample_id)
Merge demographic variables
- Identify demographic and historical variables in
b
- Identify any new data from R1 not in the baseline and merge them in
- I’m using
bUpdate as it’s the most up to date and simplifies updating the script.
bDemo <- bUpdate %>%
dplyr::select(
SSN, district, cell_field, village, sample_id,
n_season_fert, nofert_why, n_season_compost, nocompost_why, n_season_lime, nolime_why,
n_season_fallow, n_seasons_leg_1, n_seasons_leg_2, aez, contains("d_season_listd_"),
contains("inputuse_prior")
)
Append field/soil variables
rbind R1 field level variables with b field level variables to make a plot level dataset.
- Select only the variables I want to keep
- Generate any new outcomes that bring the data down to a single outcome, rather than one by plot and season.
- I can then make longitudinal outcomes from those data and merge those into the demographic data
- Put in variable here that marks whether the farmer retained their treatment status from the baseline
commonVars <- names(rs)[names(rs) %in% names(bUpdate)] # using rs because i changed baseline names to rs names
fieldDat <- rbind(bUpdate[,commonVars], rs[,commonVars]) # combine baseline and round 1
# add back in the onlyR1 variables that we want to have
soilDat is the object that has the soil variables for soil specific analyses. You can get to field observations with soil observations by dropping the A season data points.
soilDat <- fieldDat %>%
dplyr::select(one_of(soilVars), SSN, season, sample_id, d_client) %>%
filter(season!="16a") # dropping the 16a values as these aren't true measurements but a result of reshaping the round 1 data.
fieldSoilDat <- fieldDat %>%
filter(season!="16a")
Create new variables
Field variables
I originally made these new outcomes for just the round 1 data but I really want to have common outputs for plots by seasons that I can then turn into longitudinal outcomes.
fieldDat$dim <- fieldDat$field_length * fieldDat$field_width
fieldDat$are <- fieldDat$dim/100
inputVars <- names(fieldDat)[grep("fert_|quality_compost|type_compost|which_crop|which_maize", names(fieldDat))]
fieldDat[,inputVars] <- sapply(fieldDat[, inputVars], tolower)
# input quanitites
fieldDat$fert_kg_urea1 <- ifelse(fieldDat$fert_type1=="urea", fieldDat$fert_kg1, NA)
fieldDat$fert_kg_urea2 <- ifelse(fieldDat$fert_type2=="urea", fieldDat$fert_kg2, NA)
fieldDat$fert_total_urea <- apply(fieldDat[, grep("(urea.)", names(fieldDat))], 1, function(x){
sum(as.numeric(x), na.rm=T)})
fieldDat$fert_kg_dap1 <- ifelse(fieldDat$fert_type1=="dap", fieldDat$fert_kg1, NA)
fieldDat$fert_kg_dap2 <- ifelse(fieldDat$fert_type2=="dap", fieldDat$fert_kg2, NA)
fieldDat$fert_total_dap <- apply(fieldDat[, grep("(dap.)", names(fieldDat))], 1, function(x){
sum(as.numeric(x), na.rm=T)})
fieldDat$fert_kg_17npk1 <- ifelse(fieldDat$fert_type1=="npk-17", fieldDat$fert_kg1, NA)
fieldDat$fert_kg_17npk2 <- ifelse(fieldDat$fert_type2=="npk-17", fieldDat$fert_kg2, NA)
fieldDat$fert_total_17npk <- apply(fieldDat[, grep("(17npk.)", names(fieldDat))], 1, function(x){
sum(as.numeric(x), na.rm=T)})
fieldDat$fert_kg_22npk1 <- ifelse(fieldDat$fert_type1=="npk-22", fieldDat$fert_kg1, NA)
fieldDat$fert_kg_22npk2 <- ifelse(fieldDat$fert_type2=="npk-22", fieldDat$fert_kg2, NA)
fieldDat$fert_total_22npk <- apply(fieldDat[, grep("(22npk.)", names(fieldDat))], 1, function(x){
sum(as.numeric(x), na.rm=T)})
fieldDat$fert_kg_2555npk1 <- ifelse(fieldDat$fert_type1=="npk2555", fieldDat$fert_kg1, NA)
fieldDat$fert_kg_2555npk2 <- ifelse(fieldDat$fert_type2=="npk2555", fieldDat$fert_kg2, NA)
fieldDat$fert_total_2555npk <- apply(fieldDat[, grep("(2555npk.)", names(fieldDat))], 1, function(x){
sum(as.numeric(x), na.rm=T)})
#lime
fieldDat$lime_outside <- ifelse(fieldDat$d_lime=="lime_outside", fieldDat$kg_lime, NA)
fieldDat$lime_tubura <- ifelse(fieldDat$d_lime=="lime_tubura", fieldDat$kg_lime, NA)
fieldDat$lime_both <- ifelse(fieldDat$d_lime=="both_tubura_non_tubura", fieldDat$kg_lime, NA)
inputVars <- names(fieldDat)[grep("field_length|field_width|dim|fert_kg_|fert_total_|lime_", names(fieldDat))]
fieldDat[,inputVars] <-sapply(fieldDat[,inputVars], as.numeric)
#urea
fieldDat$fert_kgare_urea1 <- fieldDat$fert_kg_urea1/fieldDat$are
fieldDat$fert_kgare_urea2 <- fieldDat$fert_kg_urea2/fieldDat$are
fieldDat$fert_kgare_urea_total <- fieldDat$fert_total_urea/fieldDat$are
#dap
fieldDat$fert_kgare_dap1 <- fieldDat$fert_kg_dap1/fieldDat$are
fieldDat$fert_kgare_dap2 <- fieldDat$fert_kg_dap2/fieldDat$are
fieldDat$fert_kgare_dap_total <- fieldDat$fert_total_dap/fieldDat$are
#npk17
fieldDat$fert_kgare_17npk1 <- fieldDat$fert_kg_17npk1/fieldDat$are
fieldDat$fert_kgare_17npk2 <- fieldDat$fert_kg_17npk2/fieldDat$are
fieldDat$fert_kgare_17npk_total <- fieldDat$fert_total_17npk/fieldDat$are
#npk22
fieldDat$fert_kgare_22npk1 <- fieldDat$fert_kg_22npk1/fieldDat$are
fieldDat$fert_kgare_22npk2 <- fieldDat$fert_kg_22npk2/fieldDat$are
fieldDat$fert_kgare_22npk_total <- fieldDat$fert_total_22npk/fieldDat$are
#2555 npk
fieldDat$fert_kgare_2555npk1 <- fieldDat$fert_kg_2555npk1/fieldDat$are
fieldDat$fert_kgare_2555npk2 <- fieldDat$fert_kg_2555npk2/fieldDat$are
fieldDat$fert_kgare_2555npk_total <- fieldDat$fert_total_2555npk/fieldDat$are
Visualize field variables
fieldInputVars <- names(fieldDat)[grep("field_length|field_width|dim|fert_kgare_", names(fieldDat))]
for(i in 1:length(fieldInputVars)){
base <- ggplot(fieldDat, aes(x=fieldDat[,fieldInputVars[i]])) + labs(x = fieldInputVars[i], title=fieldInputVars[i])
temp1 <- base + geom_density()
temp2 <- base + geom_histogram()
#temp2 <- boxplot(r[,numVars[i]],main=paste0("Variable: ", numVars[i]))
multiplot(temp1, temp2, cols = 2)
}


















TODO: make certain I do some checking of these values above and if not above, here.
# fieldDat$season_16a <- ifelse(grepl("16a", fieldDat$n_tubura_season), 1, 0)
# fieldDat$season_16b <- ifelse(grepl("16b", fieldDat$n_tubura_season), 1, 0)
# fieldDat$season_17a <- ifelse(grepl("17a", fieldDat$n_tubura_season), 1, 0)
# fieldDat$notClient3Seasons <- ifelse(grepl("not_a_client", fieldDat$n_tubura_season), 1, 0)
Check field dimensions:
ggplot(fieldDat, aes(x=field_width, y=field_length)) +
geom_point() +
labs(title= "Field dimensions", x = "Width (m)", y= "Length (m)")

Map of samples
library(dismo)
if (!(exists("rwanda"))){
# Only need to geocode once per session library(dismo)
rwanda <- try(geocode("Rwanda"))
# If the internet fails, use a local value
if (class(rwanda) == "try-error") {
rwanda <- ""
# arusha$longitude <- 36.68299
# arusha$latitude <- -3.386925
}
}
See here for more on using markerClusterOptions in leaflet.
In the map below, the larger green circles are Tubura farmers and the smaller blue circles are control farmers. The number of observations will appear larger on the map because it’s plot level instead of farmer level.
e <- rs[!is.na(rs$lon),]
ss <- SpatialPointsDataFrame(coords = e[, c("lon", "lat")], data=e)
pal <- colorNumeric(c("navy", "green"), domain=unique(ss$client))
map <- leaflet() %>% addTiles() %>%
setView(lng=rwanda$longitude, lat=rwanda$latitude, zoom=8) %>%
addCircleMarkers(lng=ss$lon, lat=ss$lat,
radius= ifelse(ss$client==1, 10,6),
color = pal(ss$client),
clusterOptions = markerClusterOptions(disableClusteringAtZoom=13, spiderfyOnMaxZoom=FALSE))
map
Lessons for Nathaniel
Here are the key pieces of feedback for the next survey round:
- Variable naming convention - quite a bit of work had to be done to work with the data. Any plot specific variable should be named with _(year)(season) at the end. This will make it easy to reshape those variables into plot level variables.
- Check variables - some of the input variables are quite large. Is it possible to have CC automatically calculate quantities in a per are rate and signal the enumerator if the values seem high? Better field estimates should help with this but that sort of check would be a good reality check in the field.
- Soil texturing - how long did this take? I think we can have this done in the lab
- Seed types - not many farmers responded to the seed type question. Do we have a reason why from either farmers or enumerators?
- NAs - so many NAs in the data! Why?
- Timing for upcoming survey
- Commcare: Please ensure that the variable labels are in the right language box. The export I’m getting directly from Commcare is a mix of English and Kinyarwanda names. I assume that’s because the labels were not in the right boxes.
Analysis TODO: * feature creation (in process) * matching (talk to Maya) + * following previous template (look back) +
For next week: * talk with Maya about matching longitudinally * soil graphs
LS0tCnRpdGxlOiAiUndhbmRhIFNvaWwgSGVhbHRoIFN0dWR5IC0gUm91bmQgMSIKYXV0aG9yOiAnW01hdHQgTG93ZXNdKG1haWx0bzptYXR0Lmxvd2VzQG9uZWFjcmVmdW5kLm9yZyknCmRhdGU6ICdgciBmb3JtYXQoU3lzLnRpbWUoKSwgIiVCICVkLCAlWSIpYCcKb3V0cHV0OgogIGh0bWxfbm90ZWJvb2s6CiAgICBudW1iZXJfc2VjdGlvbnM6IHllcwogICAgY29kZV9mb2xkaW5nOiBzaG93CiAgICB0aGVtZTogZmxhdGx5CiAgICB0b2M6IHllcwogICAgdG9jX2RlcHRoOiA2CiAgICB0b2NfZmxvYXQ6IHllcwotLS0KCmBgYHtyIHNldHVwLCBpbmNsdWRlPUZBTFNFfQojIyMjIHNldCB1cAojIyBjbGVhciBlbnZpcm9ubWVudCBhbmQgY29uc29sZQpybShsaXN0ID0gbHMoKSkKY2F0KCJcMDE0IikKCiMjIHNldCB1cCBzb21lIGdsb2JhbCBvcHRpb25zCiMgYWx3YXlzIHNldCBzdHJpbmdzQXNGYWN0b3JzID0gRiB3aGVuIGxvYWRpbmcgZGF0YQpvcHRpb25zKHN0cmluZ3NBc0ZhY3RvcnM9RkFMU0UpCgojIHNob3cgdGhlIGNvZGUKa25pdHI6Om9wdHNfY2h1bmskc2V0KGVjaG8gPSBUUlVFKQoKIyBkZWZpbmUgYWxsIGtuaXRyIHRhYmxlcyB0byBiZSBodG1sIGZvcm1hdApvcHRpb25zKGtuaXRyLnRhYmxlLmZvcm1hdCA9ICdodG1sJykKCiMgY2hhbmdlIGNvZGUgY2h1bmsgZGVmYXVsdCB0byBub3Qgc2hvdyB3YXJuaW5ncyBvciBtZXNzYWdlcwprbml0cjo6b3B0c19jaHVuayRzZXQod2FybmluZyA9IEZBTFNFLCBtZXNzYWdlID0gRkFMU0UpCgpsaWJzIDwtIGMoImRwbHlyIiwgInJlc2hhcGUyIiwgImtuaXRyIiwgImdncGxvdDIiLCAidGliYmxlIiwgInJlYWR4bCIsIAogICAgIk1BU1MiLCAiZ3JpZEV4dHJhIiwgImNvd3Bsb3QiLCAicm9idXN0YmFzZSIsICJjYXIiLCAiUlN0YXRhIiwgImZvcmVpZ24iLAogICAgInRpZHlyIiwgInJlYWR4bCIpCmxhcHBseShsaWJzLCByZXF1aXJlLCBjaGFyYWN0ZXIub25seSA9IFQsIHF1aWV0bHkgPSBULCB3YXJuLmNvbmZsaWN0cyA9IEYpCgojIyMjIGRlZmluZSBoZWxwZnVsIGZ1bmN0aW9ucwojIGRlZmluZSBmdW5jdGlvbiB0byBhZGp1c3QgdGFibGUgd2lkdGhzCmh0bWxfdGFibGVfd2lkdGggPC0gZnVuY3Rpb24oa2FibGVfb3V0cHV0LCB3aWR0aCkgewogIHdpZHRoX2h0bWwgPC0gcGFzdGUwKHBhc3RlMCgnPGNvbCB3aWR0aD0iJywgd2lkdGgsICciPicpLCBjb2xsYXBzZSA9ICJcbiIpCiAgc3ViKCI8dGFibGU+IiwgcGFzdGUwKCI8dGFibGU+XG4iLCB3aWR0aF9odG1sKSwga2FibGVfb3V0cHV0KQp9CgpvcHRpb25zKCJSU3RhdGEuU3RhdGFWZXJzaW9uIiA9IDEyKQpvcHRpb25zKCJSU3RhdGEuU3RhdGFQYXRoIiA9ICIvQXBwbGljYXRpb25zL1N0YXRhL1N0YXRhU0UuYXBwL0NvbnRlbnRzL01hY09TL3N0YXRhLXNlIikKYGBgCgojIE9iamVjdGl2ZXMKClRoZSBvYmplY3RpdmVzIG9mIHRoaXMgbm90ZWJvb2sgYXJlIHRvIGFuYWx5emUgdGhlIHJlc3VsdHMgZnJvbSB0aGUgZmlyc3QgZm9sbG93IHVwIHJvdW5kIG9mIHRoZSBSd2FuZGEgbG9uZyB0ZXJtIHNvaWwgaGVhbHRoIHN0dWR5LgoKIyBLZXkgVGFrZWF3YXlzCgo+IFNlZSBzZWN0aW9uIHdpdGggW05vdGVzIGZvciBOYXRoYW5pZWxdKCNsZXNzb25zLWZvci1uYXRoYW5pZWwpCgo+IFNlZSBzZWN0aW9uIHdpdGggW05vdGVzIGZvciBQYXRyaWNrIGFuZCBTdGVwXSgjc29pbC1ub3Rlcy1mb3ItcGF0cmljay1hbmQtc3RlcCkKCj4gW1BhaXJlZCBZaWVsZCBhbmQgU29pbF0oI2NsZWFuLXNvaWwtaWRzKSBpZHMgYXJlIGEgbWVzcy4gV2UgbG9zZSBhIGxvdCBvZiBvYnNlcnZhdGlvbnMgZHVlIHRvIHVucmVjb25jaWxpYWJsZSBkdXBsaWNhdGVzIG9yIGlkcyB0aGF0IHNpbXBseSBkb24ndCBoYXZlIGEgbWF0Y2guIFdlIGxvc2UgYWxtb3N0IDUwMCBvYnNlcnZhdGlvbnMuCgo+IFNlZSBbaW5pdGlhbCB5aWVsZCByZXNwb25zZSBhbmFseXNpc10oI2luZGl2aWR1YWwtc29pbC1tb2RlbHMpCgpUT0RPIC0gY2hlY2sgcHJvamVjdGlvbiBmcm9tIGJhc2VsaW5lIG1hcHMsIGFyZSB0aGV5IHNoaWZ0ZWQgb3Zlcj8KVE9ETyAtIGhvdyB0byBjb25uZWN0IHBob3RvcyB0byBmYXJtZXJzIGZvciBlbnVtZXJhdG9ycwoKIyBEYXRhIFByZXAKCkknbSBnb2luZyB0byBsb2FkIHRoZSBiYXNlbGluZSBkYXRhIGZyb20gdGhlIGJhc2VsaW5lIGFuYWx5c2lzLiBUaGUgcmVwb3J0IGFuZCBkYXRhIGNhbiBiZSBmb3VuZCBoZXJlLiBJJ2xsIGxvYWQgdGhlIG5ldyBkYXRhIGRpcmVjdGx5IGZyb20gQ29tbUNhcmUuIFRoZSBvcmlnaW5hbCBiYXNlbGluZSBkYXRhIG9iamVjdCB3YXMgYGRgIGJ1dCBJJ20gZ29pbmcgdG8gbWFrZSBpdCBgYmAuIEVhY2ggc3Vic2VxdWVudCByb3VuZCB3aWxsIGJlIGByMWAsIGByMmAgYW5kIHNvIG9uLgoKT3ZlcmFsbCBJIHdhbnQgdG8gYnJpbmcgaW4gMyBkYXRhIHNvdXJjZXM6CgoqIEJhc2xpbmUgc3VydmV5IGRhdGEgYW5kIHNvaWwgZGF0YQoqIFJvdW5kIDEgc3VydmV5IGFuZCBhbmQgc29pbCBkYXRhIGZyb20gMTZCCiogUm91bmQgMSB5aWVsZCBhbmQgc29pbCBkYXRhIC0gdGhlc2UgZGF0YSBjb21lIGZyb20gcGFpcmVkIGNsaW1iaW5nIGJlYW4gaGFydmVzdCBtZWFzdXJlbWVudHMgYW5kIHNvaWwgc2FtcGxlcyBmcm9tIDE2QgoqIFdlIGNhbiBhbHNvIGxvb2sgYXQgbWFpemUgcGFpcmVkIHlpZWxkIGFuZCBzb2lsIHNhbXBsZXMgZnJvbSAxN0EuCgojIyBCYXNlbGluZSBkYXRhCgpgYGB7cn0KZGF0YURpciA8LSBub3JtYWxpemVQYXRoKGZpbGUucGF0aCgiLi4iLCAiLi4iLCAiZGF0YSIpKQpmb3JjZVVwZGF0ZUFsbCA8LSBGQUxTRQpgYGAKCmBgYHtyfQpiYXNlbGluZURpciA8LSBub3JtYWxpemVQYXRoKGZpbGUucGF0aCgiLi4iLCAicndfYmFzZWxpbmUiLCAiZGF0YSIpKQoKbG9hZChmaWxlPXBhc3RlMChiYXNlbGluZURpciwgIi9zaHMgcncgYmFzZWxpbmUgZnVsbCBzb2lsLlJkYXRhIikpICMgb2JqIGQKYiA8LSBiYXNlVmFycwpgYGAKCioqQ29udGV4dCBwb2ludCoqOiBUaGUgYmFzZWxpbmUgZGF0YSBoYXMgYHIgZGltKGIpWzFdYCByb3dzLiBUaGlzIGlzIGByIDI0NDgtZGltKGIpWzFdYCBmZXdlciByb3dzIHRoYW4gd2UgZXhwZWN0ZWQgaW4gdGhlIGJhc2VsaW5lLiBUaGlzIGlzIGJlY2F1c2Ugb2Ygc29tZSBmYXJtZXJzIG5vdCBiZWluZyBzdXJ2ZXllZCBhcyBleHBlY3RlZC4gU2VlIHRoZSBiYXNlbGluZSByZXBvcnQgZm9yIG1vcmUgZGV0YWlscy4gQWxzbywgdGhlc2UgYmFlc2xpbmUgdmFsdWVzIGhhdmUgdGUKCltBbGV4IFZpbGxlY10obWF0aWx0bzphbGV4LnZpbGxlY0BvbmVhY3JlZnVuZC5vcmcpIHdyb3RlIGEgY2xlYW5pbmcgc2NyaXB0IHRvIGRlYWwgd2l0aCB0aGUgZmlyc3Qgcm91bmQgb2YgUndhbmRhIFNIUyBmb2xsb3cgdXAgZGF0YSBhbmQgbWFrZSBrZXkgYWRqdXN0bWVudHMgdG8gdGhlIGRhdGEuIFRvIHV0aWxpemUgdGhhdCBkbyBmaWxlIGhlcmUsIEknbSBnb2luZyB0byBkb3dubG9hZCB0aGUgZGF0YSBmcm9tIENvbW1jYXJlLCBzYXZlIGl0LCBhbmQgaGF2ZSB0aGUgZG9maWxlIGFjY2VzcyB0aGF0IGZpbGUgdG8gZXhlY3V0ZS4gSG93ZXZlciwgdGhlIG9yaWdpbmFsIGZpbGUgQWxleCB3YXMgdXNpbmcgaGFkIGRpZmZlcmVudCB2YXJpYWJsZSBuYW1lcyB0aGFuIHRoZSBmaWxlIHB1bGxlZCBieSB0aGUgQVBJLiBUaGUgb3B0aW9ucyBmcm9tIGhlcmUgYXJlIHRvIGp1c3QgZ28gd2l0aCB0aGUgZmlsZSBmcm9tIEFsZXggb3IgdG8gYWxpZ24gdGhlIHZhcmlhYmxlIG5hbWVzIGJldHdlZW4gaGlzIHZlcnNpb24gYW5kIHRoZSBDQyB2ZXJzaW9uLiBJdCdzIHZhbHVhYmxlIHRvIGhhdmUgdGhlIGRhdGEgZGlyZWN0bHkgZnJvbSBDQyBidXQgaXQnbGwgaW52b2x2ZSBtb3JlIHdvcmsgdXAgZnJvbnQKCiMjIFJvdW5kIDEgZGF0YQoKYGBge3J9CnNvdXJjZSgiLi4vb2FmbGliL2NvbW1jYXJlRXhwb3J0LlIiKQpyIDwtIGdldEZvcm1EYXRhKCJvYWZyd2FuZGEiLCAiTSZFIiwgIjE2QiBVYnV0YWthIChTb2lsKSIsIGZvcmNlVXBkYXRlID0gZm9yY2VVcGRhdGVBbGwpCndyaXRlLmNzdihyLCBmaWxlPSJyYXdDY1IxRGF0YS5jc3YiLCByb3cubmFtZXMgPSBGKQpgYGAKClRoZSBmaXJzdCByb3VuZCBvZiBkYXRhIGZyb20gQ29tbUNhcmUgaGFzIGByIGRpbShyKVsxXWAgb2JzZXJ2YXRpb25zLiBUaGlzIGxlYXZlcyBYWCBudW1iZXIgb2YgZmFybWVycyB1bnN1cnZleWVkIGluIHRoZSBmaXJzdCBzdXJ2ZXkgcm91bmQuIFNlZSBbdGhpcyBjbGVhbmluZyBmaWxlXSh3d3cuZ2l0aHViLmNvbSkgZm9yIG1vcmUgaW5mb3JtYXRpb24gb24gdGhlIGZhcm1lcnMgd2UgZGlkIG5vdCBmaW5kIGFnYWluIGluIHRoZSBmaXJzdCBmb2xsb3cgdXAuCgpIZXJlIEknbSBnb2luZyB0byBjYWxsIHRoZSBTVEFUQSBjbGVhbmluZyBmaWxlIHRvIG1ha2UgQVYncyBjaGFuZ2VzIHRvIHRoZSBSMSBmb2xsb3cgdXAgZGF0YS4gVGhpcyByZXF1aXJlcyB0aGF0IHRoZSBkYXRhIGZyb20gQ0MgaGF2ZSB0aGUgc2FtZSB2YXJpYWJsZSBuYW1lcyBhcyB0aGUgU1RBVEEgY2xlYW5pbmcgZmlsZS4gSSdtIGdvaW5nIHRvIHRyeSB0byBleGVjdXRlIHRoYXQgaGVyZToKCmBgYHtyfQpzdGF0YURpciA8LSBub3JtYWxpemVQYXRoKGZpbGUucGF0aCgiLi4iLCAicndfcm91bmRfMV9jaGVjayIpKQpgYGAKCkhlcmUgSSBhY2Nlc3MgdGhlIHNvaWwgcHJlZGljdGlvbnMgZnJvbSB0aGUgT0FGIHNvaWwgbGFiLiBbUGF0cmljayBCZWxsXShtYWlsdG86cGF0cmljay5iZWxsQG9uZWFjcmVmdW5kLm9yZykgbWFuYWdlcyB0aGUgbGFiIGFuZCBbTWlrZSBCYXJiZXJdKG1pa2UuYmFyYmVyQG9uZWFjcmVmdW5kLm9yZykgb3ZlcnNlZXMgdGhlIHByZWRpY3Rpb24gc2NyaXB0cy4KCmBgYHtyfQpzb2lsRGlyIDwtIG5vcm1hbGl6ZVBhdGgoZmlsZS5wYXRoKCIuLiIsICIuLiIsICJPQUYgU29pbCBMYWIgRm9sZGVyIiwgIlByb2plY3RzIiwgInJ3X3Noc19zZWNvbmRfcm91bmQiLCAiNF9wcmVkaWN0ZWQiLCAib3RoZXJfc3VtbWFyaWVzIikpCnNvaWwgPC0gcmVhZC5jc3YoZmlsZT1wYXN0ZShzb2lsRGlyLCAiY29tYmluZWQtcHJlZGljdGlvbnMtaW5jbHVkaW5nLWJhZC1vbmVzLmNzdiIsIHNlcCA9ICIvIikpCgppZERpciA8LSBub3JtYWxpemVQYXRoKGZpbGUucGF0aCgiLi4iLCAiLi4iLCAiT0FGIFNvaWwgTGFiIEZvbGRlciIsICJQcm9qZWN0cyIsICJyd19zaHNfc2Vjb25kX3JvdW5kIiwgIjVfbWVyZ2VkIikpCklkZW50aWZpZXJzIDwtIHJlYWRfZXhjZWwocGFzdGUoaWREaXIsImRhdGFiYXNlLnhsc3giLHNlcD0iLyIpLCBzaGVldD0xKQpgYGAKCkNvbWJpbmUgdGhlIGF2YWlsYWJsZSBkYXRhIGJ5IGZhcm1lciBhbmQgcmVzb2x2ZSBtZXJnaW5nIGlzc3Vlcy4gVGhlc2UgZGF0YSBjYW4gYmUgY29tYmluZWQgbG9uZyBhcyBsb25nIGFzIHRoZSB2YXJpYWJsZSBuYW1lcyBhcmUgY29uc2lzdGVudCBvciB3aWRlLiBJJ20gZ29pbmcgdG8gY29tYmluZSB0aGUgZGF0YSBsb25nIGFuZCB1c2UgYHNwbGl0YCB0eXBlIGNvbW1hbmRzIHRvIGFnZ3JlZ2F0ZSB0aGUgZGF0YSBtb3JlIGVhc2lseS4gQ29uZmlybSB0aGUgdmFyaWFibGUgbmFtZXMgYXJlIGNvbnNpc3RlbnQuIEJ5IGFkdmFuY2luZyB0aGlzIGNvZGUgb24gNS85LzE3LCBJJ20gZm9yIHRoZSB0aW1lIGJlaW5nIGlnbm9yaW5nIHRoZSBjbGVhbmluZyBBbGV4IGRpZCBpbiBoaXMgZG8gZmlsZS4gSSdsbCBuZWVkIHRvIGdvIGJhY2sgYW5kIGluY29ycG9yYXRlIHRob3NlIGNoYW5nZXMuCgoqKlRPRE8qKjogc2VlIGlmIHRoZSB2YXJpYWJsZXMgbmFtZXMgaW4gQWxleCdzIHJhdyBkYXRhLCBzaGFyZWQgYnkgW05hdGhhbmllbF0obWFpbHRvOm5hdGhhbmllbC5yb3NlbmJsdW1Ab25lYWNyZWZ1bmQub3JnKSwgbWF0Y2ggdGhlIGRhdGEgSSdtIGRvd25sb2FkaW5nIGZyb20gY29tbWNhcmUuIElmIHNvLCBkb24ndCB1c2UgdGhlIGB2YXJfbmFtZXMueGxzeGAgc2hlZXQgYW5kIGluc3RlYWQgdXNlIHRob3NlIHZhcmlhYmxlIG5hbWVzIGFuZCBBbGV4J3MgZG8gZmlsZSB0byBwcmVzZXJ2ZSBhbGwgb2YgaGlzIGNoYW5nZXMuCgpOb3QgbWFueSBvZiB0aGUgbmFtZXMgYXJlIHRoZSBzYW1lLiBJJ3ZlIGRvd25sb2FkZWQgdGhlIG1ldGEgZGF0YSBmcm9tIENvbW1DYXJlIHdoaWNoIEknbGwgdXNlIHRvIHNpbXBsaWZ5IHRoZSBjbGVhbmluZyBvZiB0aGUgcm91bmQgMSBkYXRhLiBJJ20gYWxzbyBnb2luZyB0byByZXNoYXBlIHRoZSBiYXNlbGluZSB2YXJpYWJsZSBuYW1lcyB0byBzaW1wbGlmeSB0aGUgbWF0Y2hpbmcgb2YgYmFzZWxpbmUgdmFyaWFibGVzIHRvIHJvdW5kIDEgdmFyaWFibGVzLgpgYGB7ciwgbWVzc2FnZXM9Rn0KZGF0TmFtZXMgPC0gZnVuY3Rpb24oZGF0KXsKICB2YXJOYW1lcyA9IG5hbWVzKGRhdCkKICBleFZhbCA9IGRvLmNhbGwocmJpbmQsIGxhcHBseSh2YXJOYW1lcywgZnVuY3Rpb24oeCl7CiAgICB2YWwgPSBkYXRbMTozLHhdCiAgICByZXR1cm4odmFsKQogIH0pKQogIAogIG91dCA9IGNiaW5kKHZhck5hbWVzLCBleFZhbCkKICByZXR1cm4ob3V0KQp9CgpiYXNlTmFtZXMgPC0gZGF0TmFtZXMoYikKd3JpdGUuY3N2KGJhc2VOYW1lcywgZmlsZT0iYmFzZWxpbmUgdmFyIG5hbWVzLmNzdiIsIHJvdy5uYW1lcyA9IEYpCmBgYAoKTG9hZCBBbGV4J3MgcmF3IGRhdGEgYW5kIHRha2UgdGhlIHZhcmlhYmxlIG5hbWVzIGZyb20gdGhpcy4gSWYgSSBjYW4gYWxpZ24gdGhlc2UgdmFyaWFibGUgbmFtZXMgd2l0aCB0aGUgZGF0YSBmcm9tIENDIEkgY2FuIHRoZW4gZXhlY3V0ZSBBbGV4J3MgY2xlYW5pbmcgc2NyaXB0IG9uIHRoZSBDQyBkYXRhIGFuZCBwcm9jZWVkIHdpdGggY29tYmluaW5nIHRoZSBkYXRhCgojIyBTdGF0YSAuZG8gZmlsZQoKYGBge3J9CnJhd0RpciA8LSBub3JtYWxpemVQYXRoKGZpbGUucGF0aCgiU29pbCBoZWFsdGggc3R1ZHkgKHllYXIgb25lKSIsICJkYXRhIikpCgphdlJhdyA8LSByZWFkLmNzdihwYXN0ZShyYXdEaXIsICJ5MV9zaHNfcndhbmRhXzI4c2VwLmNzdiIsIHNlcCA9ICIvIiksIHN0cmluZ3NBc0ZhY3RvcnMgPSBGKQoKYGBgCgpJdCBsb29rcyBsaWtlIHRoZSBkYXRhIGZyb20gQ29tbUNhcmUgYWxpZ25zIHdpdGggdGhlIHJhdyBkYXRhIEFsZXggd29ya2VkIHdpdGggYXQgYGluZm9fZm9ybWlkYCB3aGljaCBpcyB0aGUgc2Vjb25kIGluZGV4IGZvciBgYXZSYXdgIGFuZCB0aGUgMTB0aCBpbmRleCBmb3IgYHJgLiBMZXQncyBqdXN0IHRyeSB0cmFuc2ZlcnJpbmcgdGhlbSBvdmVyIGFuZCB0aGUgd29yayBvZiB1cGRhdGluZyB0aGUgdmFyaWFibGUgbmFtZXMgdGhyb3VnaCB0aGUgQ0MgY29kZWJvb2sgZXhwb3J0IG1heSBub3QgYmUgbmVjZXNzYXJ5IQoKYGBge3J9CnZhclRlc3QgPC0gZGF0YS5mcmFtZShmcm9tY2MgPSBuYW1lcyhyKVsxMDo0MDldLCBmcm9tYXYgPSBuYW1lcyhhdlJhdylbMjo0MDFdKQojIGhlYWQodmFyVGVzdCkKIyB0YWlsKHZhclRlc3QpCiN2YXJUZXN0WzkwOjEyMCxdCndyaXRlLmNzdih2YXJUZXN0LCBmaWxlPSJ2YXJpYWJsZU5hbWVDaGVjay5jc3YiKQpgYGAKCkl0IHNlZW1zIHRvIGxpbmUgdXAgb2theSAod2l0aCBzb21lIGFkanVzdG1lbnRzKSEgVG8gaW5jb3Jwb3JhdGUgQWxleCdzIGNsZWFuaW5nIGNvZGUgSSBoYXZlIHRvIGV4cG9ydCB0aGUgZGF0YSBmcm9tIFIgdG8gYSBmb3JtIFN0YXRhIGFjY2VwdCwgcnVuIHRoZSBjb2RlLCBhbmQgdGhlbiBsb2FkIHRoZSBkYXRhIGJhY2sgaW4uCgpUaGlzIGZ1bmN0aW9uIHdpbGwgcmVtb3ZlIGFsbCBzdHJhbmdlIG91dHB1dHMgZnJvbSB0aGUgZGF0YSBmcm9tIENvbW1DYXJlIHNvIHRoYXQgdGhlIFNUQVRBIGNvZGUgd29ya3MKCmBgYHtyfQpjaGFyQ2xlYW4gPC0gZnVuY3Rpb24oZGYpewogIAogIGRmIDwtIGFzLmRhdGEuZnJhbWUobGFwcGx5KGRmLCBmdW5jdGlvbih4KXsKICB4ID0gZ3N1YigiJyIsICcnLCB4KQogIHggPSBnc3ViKCJeYiIsICcnLCB4KQogIHggPSBpZmVsc2UoZ3JlcGwoIm1hcCBvYmplY3QiLCB4KT09VCwgTkEsIHgpCiAgcmV0dXJuKHgpCiAgfSkpCnJldHVybihkZikKfQoKciA8LSBjaGFyQ2xlYW4ocikKYGBgCgpIZXJlIGlzIHdoZXJlIEkgYWN0dWFsbHkgdXBkYXRlIHRoZSBuYW1lcyBpbiBgcmAgdG8gbWF0Y2ggQWxleCdzIG9yaWdpbmFsIGRhdGEuCgpgYGB7cn0KbmFtZXMocilbMTA6NDA5XSA8LSBuYW1lcyhhdlJhdylbMjo0MDFdCgojZXhwb3J0IHNvIHN0YXRhIGNhbiBydW4gLSBjaGVjayBmb3IgdmFyaWFibGUgbmFtZXMgbG9uZ2VyIHRoYW4gMzJjaGFyCnRhYmxlKG5jaGFyKG5hbWVzKHIpKSkKCndyaXRlLmNzdihyLCBmaWxlPSJ0b0JlQ2xlYW5lZFN0YXRhLmNzdiIsIHJvdy5uYW1lcyA9IEYpCgpzdGF0YSgiY2xlYW5zX3kxX3Noc19yd2FuZGEuZG8iLCBzdGF0YS5lY2hvPUYpCmBgYAoKTm93IGxvYWQgdGhlIHJlc3VsdCBvZiB0aGUgU3RhdGEgZmlsZQpgYGB7cn0KciA8LSByZWFkLmNzdigiY2xlYW5lZGZvclIuY3N2Iiwgc3RyaW5nc0FzRmFjdG9ycyA9IEYpCmBgYAoKCiMgQ2xlYW5pbmcKClRoZSBgcmAgZGF0YWZyYW1lIGhhcyBtYW55IG1vcmUgdmFyaWFibGVzIHRoYW4gdGhlIGJhc2VsaW5lIHN1cnZleS4gVGhpcyB3YXMgaW4gcGFydCBleHBlY3RlZDsgd2UgYWRkZWQgcXVlc3Rpb25zIHRvIHRoZSBmaXJzdCBmb2xsb3cgdXAgcm91bmQgYmFzZWQgb24gbGVzc29ucyBmcm9tIHRoZSBiYXNlbGluZS4gSXQncyBhbHNvIGR1ZSB0byBob3cgdGhlIHN1cnZleSB3YXMgc2V0IHVwIGluIENvbW1DYXJlLiBCZWZvcmUgY29tYmluaW5nIHRoZSBiYXNlbGluZSBhbmQgdGhlIGZpcnN0IGZvbGxvdyB1cCByb3VuZCBJIG5lZWQgdG86CgoqIHJlc2hhcGUgdGhlIHJvdW5kIDEgdmFyaWFibGVzIHNvIHRoYXQgdGhleSBhcHByb3ByaWF0ZWx5IG1hdGNoIHRoZSBiYXNlbGluZSB2YXJpYWJsZXMKKiBDbGVhbiB0aG9zZSB2YXJpYWxlcyBvciBwcmVwYXJlIHRoZW0gYXMgbmVlZCBiZSBmb3IgYSAKKiBGb3IgdmFyaWFibGVzIHdpdGggbm8gbWF0Y2gsIGNsZWFuCgojIyBEcm9wIHZhcmlhYmxlcwpgYGB7cn0KdG9Ecm9wIDwtIGMoImFwcGZvcm1pZCIsICJpZCIsICJkb21haW4iLCAibWV0YWRhdGFkZXZpY2VpZCIpCnIgPC0gclssIW5hbWVzKHIpICVpbiUgdG9Ecm9wXQpgYGAKCgpgYGB7cn0Kc291cmNlKCIuLi9vYWZsaWIvbWlzYy5SIikKbmFtZXMocikgPC0gZ3N1YigiXnkxX3xpbnRyb18iLCAiIiwgbmFtZXMocikpCnJbcj09Ii4iXSA8LSBOQQoKciA8LSBkaXZpZGVHcHMociwgImdwc19jb29yZCIpCmBgYAoKIyMgQ2F0ZWdvcmljYWwgdmFyaWFibGVzCgpUaGUgcmVzcG9uc2VzIG9mIHRoZSBjYXRlZ29yaWNhbCB2YXJpYWJsZXMgc2hvdWxkIGJlIHJlZ3VsYXRlZCB0aHJvdWdoIENDLCBob3dldmVyLCB0byBjaGVjaywgbWFrZSBhIHRhYmxlIHRoYXQgc2hvd3MgdGhlIHRvcCB0ZW4gcmVzcG9uc2VzIGluIGRlc2NlbmRpbmcgb3JkZXIgYW5kIG1ha2UgYSBncmFwaCBvZiByZXNwb25zZSBjb3VudHMgdG8ga25vdyB3aGF0IHRvIGNoZWNrLiBJJ2xsIHRoZW4gY2FwdHVyZSBhbnkgY2hhcmFjdGVycyB0aGF0IHNob3VsZCBiZSBudW1lcmljIGFuZCBjb252ZXJ0IHRoZW0uCgpgYGB7cn0KY2F0VmFycyA8LSBuYW1lcyhyKVtzYXBwbHkociwgZnVuY3Rpb24oeCl7CiAgaXMuY2hhcmFjdGVyKHgpCn0pXQoKZW51bUNsZWFuIDwtIGZ1bmN0aW9uKGRhdCwgeCwgdG9SZW1vdmUpewogIGRhdFsseF0gPC0gaWZlbHNlKGRhdFsseF0gJWluJSB0b1JlbW92ZSwgTkEsIGRhdFsseF0pCiAgcmV0dXJuKGRhdFsseF0pCn0KCnN0clRhYmxlIDwtIGZ1bmN0aW9uKGRhdCwgeCl7CiAgdmFyTmFtZSA9IHgKICB0YWIgPSBhcy5kYXRhLmZyYW1lKHRhYmxlKGRhdFsseF0sIHVzZU5BID0gJ2lmYW55JykpCiAgdGFiID0gdGFiW29yZGVyKHRhYiRGcmVxLCBkZWNyZWFzaW5nID0gVCksXQogIGVuZCA9IGlmZWxzZShsZW5ndGgodGFiJFZhcjEpPDEwLCBsZW5ndGgodGFiJFZhcjEpLCAxMCkKICByZXBPcmRlciA9IHBhc3RlKHRhYiRWYXIxWzE6ZW5kXSwgY29sbGFwc2U9IiwgIikKICBvdXQgPSBkYXRhLmZyYW1lKHZhcmlhYmxlID0gdmFyTmFtZSwKICAgICAgICAgICAgICAgICAgIHJlc3BvbnNlcyA9IHJlcE9yZGVyKQogIAogIHJldHVybihvdXQpCn0KCiMgY2xlYW4gdXAga25vd24gdmFsdWVzCmNhdEVudW1WYWxzIDwtIGMoIi05OSIsICItODgiLCAiLSA5OSIsICItOTkuMCIsICI4OCIsICJfODgiLCAiLSA4OCIsICIwLjg4IiwKICAgICAgICAgICAgICAgICAiLS04OCIsICJfXzg4IiwgIi04OC4wIiwgIjk5LjAiKQpyWyxjYXRWYXJzXSA8LSBzYXBwbHkoY2F0VmFycywgZnVuY3Rpb24oeSl7CiAgclsseV0gPC0gZW51bUNsZWFuKHIseSwgY2F0RW51bVZhbHMpCn0pCgoKcmVzcG9uc2VUYWJsZSA8LSBkby5jYWxsKHJiaW5kLCBsYXBwbHkoY2F0VmFycywgZnVuY3Rpb24oeCl7CiAgc3RyVGFibGUociwgeCkKfSkpCgpgYGAKCiMjIyBDYXRlZ29yaWNhbCByZXNwb25zZSB0YWJsZQoKQSBzaW1wbGUgdGFibGUgdG8gcHJldmlldyB0aGUgdmFsdWVzIGluIHRoZSBkYXRhLiBUaGUgdmFsdWVzIGFyZSByYW5rZWQgYnkgZnJlcXVlbmN5LgoKYGBge3J9CmthYmxlKHJlc3BvbnNlVGFibGUpCmBgYAoKIyMjIENhdGVnb3JpY2FsIHJlc3BvbnNlIGdyYXBocwpgYGB7cn0KcmVwR3JhcGhzIDwtIGZ1bmN0aW9uKGRhdCwgeCl7CiAgdGFiID0gYXMuZGF0YS5mcmFtZSh0YWJsZShkYXRbLHhdLCB1c2VOQSA9ICdpZmFueScpKQogIHRhYiA9IHRhYltvcmRlcih0YWIkRnJlcSwgZGVjcmVhc2luZyA9IFQpLF0KICBwcmludCgKICAgIGdncGxvdChkYXRhPXRhYiwgYWVzKHg9VmFyMSwgeT1GcmVxKSkgKyBnZW9tX2JhcihzdGF0PSJpZGVudGl0eSIpICsKICAgICAgdGhlbWUobGVnZW5kLnBvc2l0aW9uID0gImJvdHRvbSIsIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gNDUsIGhqdXN0ID0gMSkpICsKICAgICAgbGFicyh0aXRsZSA9cGFzdGUwKCJDb21wb3NpdGlvbiBvZiB2YXJpYWJsZTogIiwgeCkpCiAgKQp9CgphZG1pblZhcnMgPC0gYyhuYW1lcyhyKVtncmVwKCJtZXRhIiwgbmFtZXMocikpXSwgInN0YXJ0X3RpbWUiLCAiZW51bV9uYW1lIiwgInBob3RvIiwgImNlbGxfZmllbGQiLCAidmlsbGFnZSIsICJmYXJtZXJfcmVzcG9uZCIsICJmYXJtZXJfcGhvbmVudW1iZXIiLCAiZF9waG9uZSIsICJuZWlnaGJvcl9waG9uZW51bWJlciIsICJmYXJtZXJfbGlzdCIsICJ1bmlxdWVfbG9jYXRpb24iLCAiY29tbWVudHMiLCAiZ3BzX2Nvb3JkIiwgInNhbXBsZV9pZCIsICJTU04iKQpub25BZG1pblZhcnMgPC0gY2F0VmFyc1shY2F0VmFycyAlaW4lIGFkbWluVmFyc10KCmZvcihpIGluIDE6bGVuZ3RoKG5vbkFkbWluVmFycykpewogIHJlcEdyYXBocyhyLCBub25BZG1pblZhcnNbaV0pCn0KYGBgCgojIyMgTWFudWFsIGNoYXJhY3RlciBjbGVhbmluZwpgYGB7cn0KciRmZW1hbGUgPC0gaWZlbHNlKHIkZ2VuZGVyPT0iZmVtYWxlIiwgMSwgMCkKciRkaXN0cmljdCA8LSBpZmVsc2UoZ3JlcGwoIm55YW56YSIsIHIkZGlzdHJpY3QpPT1ULCAiTnlhbnphIiwgciRkaXN0cmljdCkKCiN0YWJsZShyJGtnX3NlZWRfMTZiXzEpCiN0YWJsZShyJGtnX3lpZWxkXzE2YV8yKQoKc3RydG9OdW0gPC0gYygia2dfc2VlZF8xNmJfMSIsICJrZ195aWVsZF8xNmFfMSIsICJrZ195aWVsZF8xNmJfMSIsICJrZ195aWVsZF8xNmJfMiIpCnJbLHN0cnRvTnVtXSA8LSBzYXBwbHkoclssc3RydG9OdW1dLCBmdW5jdGlvbih4KXthcy5udW1lcmljKHgpfSkKYGBgCgojIyMgQ2F0ZWdvcmljYWwgY2xlYW5pbmcKClRPRE8gaGVyZSEKCk5vdGVzIG9uIHRoZSBjYXRlZ29yaWNhbCB2YXJpYWJsZXM6CgoqIFdlIGRvbid0IGhhdmUgbWFueSBhY3R1YWwgcmVzcG9uc2VzIG9uIHNlZWQgdHlwZSBkZXNwaXRlIGFsbCBmYXJtZXJzIHRlbGxpbmcgdXMgYWJvdXQgYSBjcm9wIHRoZXkgYXJlIGdyb3dpbmcuIFdoeT8gQ2hlY2sgdGhhdCB0aGVyZSB3YXNuJ3QgYSBtaXNsYWJlbGluZyBvZiB2YXJpYWJsZXMuCiogQ2hlY2sgdGhlICd3aGljaF9tYWl6ZV9zZWVkJyB2YXJpYWJsZXMgdG8gbWFrZSBjZXJ0YWluIHRoZXkncmUgZmxleGlibGUgdG8gdGhlIHR5cGUgb2YgY3JvcCBzZWxlY3RlZCBpbiB0aGUgcHJldmlvdXMgcXVlc3Rpb24uCiogQ29uZmlybSB0aGF0IGJsYW5rIGlzIE5BIG5vdCAwLgoKIyMgTnVtZXJpYyB2YXJpYWJsZXMKCmBgYHtyfQpudW1WYXJzIDwtIG5hbWVzKHIpW3NhcHBseShyLCBmdW5jdGlvbih4KXsKICBpcy5udW1lcmljKHgpCn0pXQpgYGAKCkJhc2ljIGNsZWFuaW5nIG9mIGtub3duIGlzc3VlcyBsaWtlIGVudW1lcmF0b3IgY29kZXMgZm9yIERLLCBOV1IsIGV0Yy4KYGBge3J9CmVudW1WYWxzIDwtIGMoLTg4LC04NSwgLTk5KQoKclssbnVtVmFyc10gPC0gc2FwcGx5KG51bVZhcnMsIGZ1bmN0aW9uKHkpewogIHJbLHldIDwtIGVudW1DbGVhbihyLHksIGVudW1WYWxzKQp9KQpgYGAKCiMjIyBOdW1lcmljIG91dGxpZXIgdGFibGUKCmBgYHtyfQppcXIuY2hlY2sgPC0gZnVuY3Rpb24oZGF0LCB4KSB7IAogIHExID0gc3VtbWFyeShkYXRbLHhdKVtbMl1dCiAgcTMgPSBzdW1tYXJ5KGRhdFsseF0pW1s1XV0gCiAgaXFyID0gcTMtcTEKICBtYXJrICA9IGlmZWxzZShkYXRbLHhdIDwgKHExIC0gKDEuNSppcXIpKSB8IGRhdFsseF0gPiAocTMgKyAoMS41KmlxcikpLCAxLDApCiAgdGFiID0gcmJpbmQoCiAgICBzdW1tYXJ5KGRhdFsseF0pLAogICAgc3VtbWFyeShkYXRbbWFyaz09MCwgeF0pCiAgKQogIHJldHVybih0YWIpCn0KCiMgcmVtb3ZlIGFkbWluIHZhcnMKbnVtQWRtaW5WYXJzIDwtIGMobnVtVmFyc1sxOjNdKQpudW1WYXJzTm90QWRtaW4gPC0gbnVtVmFyc1shbnVtVmFycyAlaW4lIG51bUFkbWluVmFyc10KCmlxclRhYiA8LSBkby5jYWxsKHBseXI6OnJiaW5kLmZpbGwsIGxhcHBseShudW1WYXJzTm90QWRtaW4sIGZ1bmN0aW9uKHkpewogICNwcmludCh5KQogIHJlcyA9IGlxci5jaGVjayhyLCB5KQogICNwcmludChkaW0ocmVzKSkKICBvdXQgPSBkYXRhLmZyYW1lKHZhcj1yYmluZCh5LCBwYXN0ZSh5LCAiLmlxciIsIHNlcD0iIikpLCByZXMpCiAgcmV0dXJuKG91dCkKfSkpCgppcXJUYWJbLDI6OF0gPC0gc2FwcGx5KGlxclRhYlssMjo4XSwgZnVuY3Rpb24oeCl7cm91bmQoeCwxKX0pCmBgYAoKVGhlIG91dGxpZXIgdGFibGUgc3VtbWFyaXplcyB0aGUgbnVtZXJpYyB2YXJpYWJsZXMgd2l0aCBhbmQgd2l0aG91dCBJUVIgb3V0bGllcnMgdG8gc2hvdyBob3cgdGhlIGRhdGEgY2hhbmdlcyBiYXNlZCBvbiB0aGlzIGZpbHRlci4KCmBgYHtyfQprbml0cjo6a2FibGUoaXFyVGFiLCByb3cubmFtZXMgPSBGLCBkaWdpdHMgPSAwLCBmb3JtYXQgPSAnbWFya2Rvd24nKQpgYGAKCiMjIyBPdXRsaWVyIEdyYXBocwpgYGB7cn0KIyBodHRwOi8vcmZvcnB1YmxpY2hlYWx0aC5ibG9nc3BvdC5jb20vMjAxNC8wMi9nZ3Bsb3QyLWNoZWF0c2hlZXQtZm9yLXZpc3VhbGl6aW5nLmh0bWwKZm9yKGkgaW4gMTpsZW5ndGgobnVtVmFyc05vdEFkbWluKSl7CiAgICBiYXNlIDwtIGdncGxvdChyLCBhZXMoeD1yWyxudW1WYXJzTm90QWRtaW5baV1dKSkgKyBsYWJzKHggPSBudW1WYXJzTm90QWRtaW5baV0pCiAgICB0ZW1wMSA8LSBiYXNlICsgZ2VvbV9kZW5zaXR5KCkKICAgIHRlbXAyIDwtIGJhc2UgKyBnZW9tX2hpc3RvZ3JhbSgpCiAgICAjdGVtcDIgPC0gYm94cGxvdChyWyxudW1WYXJzW2ldXSxtYWluPXBhc3RlMCgiVmFyaWFibGU6ICIsIG51bVZhcnNbaV0pKQogICAgbXVsdGlwbG90KHRlbXAxLCB0ZW1wMiwgY29scyA9IDIpCn0KYGBgCgojIyMgTnVtZXJpYyB2YXJpYWJsZSBjbGVhbmluZwoKVE9ETyBoZXJlIQoKIyMgTWVyZ2UgaW4gc29pbCBkYXRhCgpGaXJzdCBtZXJnZSB0aGUgc29pbCBkYXRhIHdpdGggdGhlIGlkZW50aWZpZXJzIGFzIHdlIHNob3VsZCBnZXQgZnVsbCBtYXRjaGVzLiBUaGVuIG1lcmdlIHNvaWwgZGF0YSB0byB0aGUgc3VydmV5IGRhdGEKCmBgYHtyfQpJZGVudGlmaWVycyA8LSBJZGVudGlmaWVycyAlPiUgcmVuYW1lKAogIHNhbXBsZV9pZCA9IGBTYW1wbGUgSURgLAogIFNTTiA9IGBMYWIgc3NuYAopICU+JSBtdXRhdGUoCiAgc2FtcGxlX2lkID0gZ3N1YigiICIsICIiLCB0b2xvd2VyKHNhbXBsZV9pZCkpCikKCnRhYmxlKElkZW50aWZpZXJzJFNTTiAlaW4lIHNvaWwkU1NOKSAjIGZ1bGwgbWF0Y2hlcwoKc29pbCA8LSBsZWZ0X2pvaW4oc29pbCwgSWRlbnRpZmllcnNbLCBjKCJTU04iLCAic2FtcGxlX2lkIildLCBieT0iU1NOIikgCmBgYAoKV2UgaGF2ZSBzb21lIHN1cnZleXMgdGhhdCBkb24ndCBoYXZlIHNvaWwgZGF0YS4gSXQgc2VlbXMgdGhlIHNvaWwgc2FtcGxlIGlkIGluIHRoZSBgSWRlbnRpZmllcnNgIGRhdGEgYXJlIGEgYml0IG1lc3N5LiBMZXQncyBjbGVhbiBib3RoIHVwIGFib3ZlIGJ5IHJlbW92aW5nIHNwYWNlcyBhbmQgbWFraW5nIGxvd2VyIGNhc2UuCgpgYGB7cn0KciRzYW1wbGVfaWQgPC0gdG9sb3dlcihyJHNhbXBsZV9pZCkKCnRhYmxlKHIkc2FtcGxlX2lkICVpbiUgc29pbCRzYW1wbGVfaWQpCnIkc2FtcGxlX2lkWyFyJHNhbXBsZV9pZCAlaW4lIHNvaWwkc2FtcGxlX2lkXQoKd3JpdGUuY3N2KHIkc2FtcGxlX2lkWyFyJHNhbXBsZV9pZCAlaW4lIHNvaWwkc2FtcGxlX2lkXSwgInN1cnZleXNXb1NvaWwuY3N2Iiwgcm93Lm5hbWVzID0gRikKYGBgCgpBbmQgc29tZSBzb2lsIHNhbXBsZV9pZCB0aGF0IGRvbid0IGhhdmUgYSBzdXJ2ZXkKYGBge3J9CnNvaWwkc2FtcGxlX2lkWyFzb2lsJHNhbXBsZV9pZCAlaW4lIHIkc2FtcGxlX2lkXQp3cml0ZS5jc3Yoc29pbCRzYW1wbGVfaWRbIXNvaWwkc2FtcGxlX2lkICVpbiUgciRzYW1wbGVfaWRdLCAic29pbHNXb1N1cnZleS5jc3YiLCByb3cubmFtZXMgPSBGKQpgYGAKCmBgYHtyfQpkaW0ocikKciA8LSBsZWZ0X2pvaW4ociwgc29pbCwgYnk9InNhbXBsZV9pZCIpCmRpbShyKSAjIHdoeSBpcyBpdCBvbmUgcm93IGxvbmdlciBhZnRlciB0aGUgbGVmdF9qb2luPwpgYGAKCgojIyBTb2lsIHZhbHVlcwpgYGB7cn0KZ2dwbG90KHIsIGFlcyh4PUNhbGNpdW0sIHk9TWFnbmVzaXVtKSkgKyBnZW9tX3BvaW50KCkgKwogICAgc3RhdF9zbW9vdGgobWV0aG9kPSJsb2VzcyIpICsKICAgIGxhYnMoeCA9ICJDYWxjaXVtIChtMykiLCB5PSAiTWFnbmVzaXVtIChtMykiLCB0aXRsZT0iQ2FsY2l1bSBhbmQgTWFnbmVzaXVtIHJlbGF0aW9uc2hpcCIpCgpnZ3Bsb3QociwgYWVzKHg9cEgsIHk9Q2FsY2l1bSkpICsgZ2VvbV9wb2ludCgpICsKICBzdGF0X3Ntb290aChtZXRob2Q9ImxvZXNzIikgKwogIGxhYnMoeCA9ICJwSCIsIHk9IkNhbGNpdW0gKG0zKSIsIHRpdGxlID0gInBIIGFuZCBDYWxjaXVtIHJlbGF0aW9uc2hpcCIpCgpnZ3Bsb3QociwgYWVzKHg9cEgsIHk9TWFnbmVzaXVtKSkgKyBnZW9tX3BvaW50KCkgKwogIHN0YXRfc21vb3RoKG1ldGhvZD0ibG9lc3MiKSArCiAgbGFicyh4ID0gInBIIiwgeT0iTWFnbmVzaXVtIChtMykiLCB0aXRsZSA9ICJwSCBhbmQgTWFnbmVzaXVtIHJlbGF0aW9uc2hpcCIpCgpnZ3Bsb3QociwgYWVzKHg9cEgsIHk9WC5FeGNoYW5nZWFibGUuQWNpZGl0eSkpICsgZ2VvbV9wb2ludCgpICsKICBzdGF0X3Ntb290aChtZXRob2Q9ImxvZXNzIikgKwogIGxhYnMoeCA9ICJwSCIsIHk9IkV4Y2hhbmdlYWJsZSBBbHVtaW51bSIsIHRpdGxlID0gInBIIGFuZCBBbHVtaW51bSByZWxhdGlvbnNoaXAiKQoKZ2dwbG90KHIsIGFlcyh4PVguT3JnYW5pYy5DYXJib24sIHk9WC5Ub3RhbC5OaXRyb2dlbikpICsgZ2VvbV9wb2ludCgpICsgCiAgc3RhdF9zbW9vdGgobWV0aG9kPSJsb2VzcyIpICsKICBsYWJzKHggPSAiVG90YWwgQ2FyYm9uIiwgeT0iVG90YWwgTml0cm9nZW4iLCB0aXRsZSA9ICJDYXJib24gYW5kIE5pdHJvZ2VuIHJlbGF0aW9uc2hpcCIpCmBgYAoKYGBge3J9CnNvaWxWYXJzIDwtIG5hbWVzKHIpW3doaWNoKG5hbWVzKHIpPT0icEgiKTp3aGljaChuYW1lcyhyKT09IlguVG90YWwuTml0cm9nZW4iKV0Ka2V5U29pbFZhcnMgPC0gYygicEgiLCAiWC5PcmdhbmljLkNhcmJvbiIsICJYLlRvdGFsLk5pdHJvZ2VuIiwgIkNhbGNpdW0iLCAiTWFnbmVzaXVtIikKd3JpdGUuY3N2KHNvaWxWYXJzLCBmaWxlPSJzb2lsVmFyc2ZvclN0ZXAuY3N2Iiwgcm93Lm5hbWVzID0gRikKYGBgCgojIyMgSW5pdGlhbCBUIHZzLiBDIHNvaWwgY29tcGFyaXNvbgoKKipQbGVhc2Ugbm90ZSoqOiBUaGVzZSBhcmUgcmF3IGNvbXBhcmlzb25zIHVzaW5nIG9ubHkgcm91bmQgMSBkYXRhIGFuZCB0aHVzIHNob3VsZCBub3QgYmUgdGFrZW4gYXMgaW5pdGlhbCBmaW5kaW5ncyBmb3IgaG93IFQgYW5kIEMgZmFybWVycyBjb21wYXJlLiBGYXJtZXJzIHdpbGwgYmUgbWF0Y2hlZCB0byBlbnN1cmUgYSBwcm9wZXIgY29tcGFyaXNvbi4KCmBgYHtyfQpmb3IoaSBpbiAxOmxlbmd0aChzb2lsVmFycykpewogIHAxIDwtIGdncGxvdChkYXRhPXIsIGFlcyh4PWFzLmZhY3RvcihkX2NsaWVudF8xNmIpLCB5PXJbLHNvaWxWYXJzW2ldXSkpICsgCiAgICBnZW9tX2JveHBsb3QoKSArCiAgICBsYWJzKHg9IlR1YnVyYSBGYXJtZXIiLCB5PXNvaWxWYXJzW2ldKQogIHAyIDwtIGdncGxvdChkYXRhPXIsIGFlcyh4PXJbLHNvaWxWYXJzW2ldXSkpICsgCiAgICBnZW9tX2RlbnNpdHkoKSArIAogICAgbGFicyh4PXNvaWxWYXJzW2ldKQogIG11bHRpcGxvdChwMSwgcDIsIGNvbHM9MikKfQoKCmBgYAoKIyMjIFNvaWwgbm90ZXMgZm9yIFBhdHJpY2sgYW5kIFN0ZXAKCiogVGhlIGNhcmJvbiB2cy4gbml0cm9nZW4gc2NhdHRlciBwbG90IGxvb2tzIG9kZCBpbiB0aGF0IHRoZSB2YWx1ZXMgYXJlIGNsdW1wZWQgaW4gZGlzY3JldGUgbGluZXMuIFdoeSBtaWdodCB0aGF0IGJlPwoqIFdoYXQgYXJlIGFwcHJvcHJpYXRlIGN1dG9mZiB2YWx1ZXMgZm9yIHRoZSBsYWIgcHJlZGljdGlvbnM/IChQYXRyaWNrLCBhcyBhIGdlbmVyYWwgcXVlc3Rpb24sIHdlIHNob3VsZCBwcm9iYWJseSBhcHBseSB0aG9zZSBjdXRvZmZzIHRvIGFueSBsYWIgZGF0YSBiZWZvcmUgc2hhcmluZyBpdCB3aXRoIHRoZSB0ZWFtcyB0byBzaW1wbGlmeSB3b3JraW5nIHdpdGggdGhvc2UgZGF0YSkKCiMjIyBTb2lsIHZhbHVlIGNsZWFuaW5nCgpTdGVwIGFuZCBQYXRyaWNrIHNheSB0aGF0IGl0J3MgaGFyZCB0byBzZXQgaGFyZCBhbmQgZmFzdCBndWlkZWxpbmVzIGZvciB3aGF0IGFyZSBhbmQgYXJlIG5vdCByZWFzb25hYmxlIHZhbHVlcy4gSSdtIHRoZXJlZm9yZSBnb2luZyB0byBzZWUgd2hhdCBoYXBwZW5zIHRvIHRoZSBkYXRhIGlmIHdlIHRyaW0gYnkgc2QgYW5kIElRUiBhbmQgdGhlbiBhcHBseSBvbmUgb2YgdGhvc2UgYWRqdXN0bWVudHMgdG8gdGhlIGRhdGEuCgpgYGB7cn0KY2hlY2suM3NkIDwtIGZ1bmN0aW9uKHgpIHsKICB4ID0gaWZlbHNlKGlzLmluZmluaXRlKHgpLCBOQSwgeCkKICBtZWFuID0gbWVhbih4LCBuYS5ybT1UKQogIHNkID0gc2QoeCwgbmEucm09VCkKICBtYXJrID0gaWZlbHNlKHg+KG1lYW4gKyAoMypzZCkpIHwKICAgICAgICB4PChtZWFuIC0gKDMqc2QpKSwgTkEsIHgpCiAgcmV0dXJuKG1hcmspCn0KCgpzZFNvaWxWYWxzIDwtIHIgJT4lCiAgZHBseXI6OnNlbGVjdChwSDpYLlRvdGFsLk5pdHJvZ2VuKSAKCnNkQ2hlY2sgPC0gYXMuZGF0YS5mcmFtZShhcHBseShzZFNvaWxWYWxzLCAyLCBmdW5jdGlvbih4KXsKICByZXR1cm4oY2hlY2suM3NkKHgpKQp9KSkKYGBgCgpgYGB7cn0KZm9yKGkgaW4gMTpsZW5ndGgoc29pbFZhcnMpKXsKICBwcmludChnZ3Bsb3QoZGF0YT1zZENoZWNrLCBhZXMoeD1zZENoZWNrWyxzb2lsVmFyc1tpXV0pKSArIAogICAgZ2VvbV9kZW5zaXR5KCkgKyAKICAgIGxhYnMoeD1zb2lsVmFyc1tpXSkKICApCn0KCmBgYAoKKipJbXBvcnRhbnQgbm90ZSoqOiBJJ20gZ29pbmcgdG8gYWRkIHRoZSBhZGp1c3RlZCB2YWx1ZXMgdG8gdGhlIGByYCBkYXRhIGZyYW1lIGdpdmluZyB0aGUgcHJldmlvdXMgdmFyaWFibGVzIHRoZSBleHRlbnNpb24gYC5yYXdgIHNvIEkgY2FuIGRpc3Rpbmd1aXNoIGJldHdlZW4gdGhlIG9yaWdpbmFsIGFuZCBtb2RpZmllZCBkYXRhLgoKYGBge3J9Cm5hbWVzKHIpW3doaWNoKG5hbWVzKHIpPT0icEgiKTp3aGljaChuYW1lcyhyKT09IlguVG90YWwuTml0cm9nZW4iKV0gPC0gcGFzdGUwKG5hbWVzKHIpW3doaWNoKG5hbWVzKHIpPT0icEgiKTp3aGljaChuYW1lcyhyKT09IlguVG90YWwuTml0cm9nZW4iKV0sICIucmF3IikKCnIgPC0gY2JpbmQociwgc2RDaGVjaykKYGBgCgoKIyMgQ2hlY2sgZm9yIHVuaXF1ZSBpZHMKCkknbSBzZWVpbmcgdGhhdCB0aGVyZSBhcmUgZHVwbGljYXRlZCBmYXJtZXJzIGluIHRoZSBkYXRhIHdoZW4gSSdtIHRyeWluZyB0byByZXNoYXBlIHRoZSBgcmAgZGF0YSBmcm9tIHdpZGUgdG8gbG9uZy4gTGV0J3MgY2hlY2sgdGhlbSBvdXQgaGVyZSBhbmQgc2VlIGlmIHdlIGNhbiBmaWd1cmUgb3V0IHdoaWNoIG9ic2VydmF0aW9uIGlzIHJpZ2h0LiAKCiogQ2hlY2sgQWxleCdzIGRvIGZpbGUgdG8gc2VlIGlmIHRoZXJlJ3MgbWVudGlvbiBvZiB0aGVzZSBmYXJtZXJzLiBbTm8gbWVudGlvbl0KKiBDaGVjayB0aGUgYmFzZWxpbmUgdmFsdWVzIGFzIHRoZXNlIHNob3VsZCBsaW5lIHVwLgoKYGBge3J9Cmxlbmd0aChyJHNhbXBsZV9pZCk9PWxlbmd0aCh1bmlxdWUociRzYW1wbGVfaWQpKQpkdXBzIDwtIHIkc2FtcGxlX2lkW2R1cGxpY2F0ZWQociRzYW1wbGVfaWQpXQpkdXBJbmRleCA8LSB3aGljaChkdXBsaWNhdGVkKHIkc2FtcGxlX2lkKSkKCiNkdXBEYXQgPC0gcltyJHNhbXBsZV9pZCAlaW4lIGR1cHMsXQojaGVhZChyW3Ikc2FtcGxlX2lkPT1kdXBzWzFdLF0pCiNoZWFkKHJbciRzYW1wbGVfaWQ9PWR1cHNbMl0sXSkKYGBgCgpMZXQncyBzb2x2ZSB0aGUgdW5pcXVlIGlkIGlzc3VlIGJ5IGxvb2tpbmcgYXQgaWRlbnRpZnlpbmcgaW5mb3JtYXRpb24gaW4gdGhlIGJhc2VsaW5lIGRhdGEKYGBge3J9Cgpyb3VuZElkIDwtIHIgJT4lCiAgZHBseXI6OnNlbGVjdChkaXN0cmljdCwgY2VsbF9maWVsZCwgdmlsbGFnZSwgc2FtcGxlX2lkLCBmYXJtZXJfbGlzdCkgJT4lCiAgZmlsdGVyKHIkc2FtcGxlX2lkICVpbiUgZHVwcykKCgoKI2QKbG9hZCgicmF3QmFzZWxpbmVXaXRoSWRlbnRpZmVycy5SZGF0YSIpCmJhc2VJZCA8LSBkICU+JSAKICBkcGx5cjo6c2VsZWN0KGRpc3RyaWN0LCBzZWxlY3RlZF9jZWxsLCB1bXVkdWd1ZHUsICBzYW1wbGVfaWQsIGZhcm1lcl9uYW1lICkgJT4lCiAgZmlsdGVyKGQkc2FtcGxlX2lkICVpbiUgZHVwcykKCiNiYXNlSWQKI3JvdW5kSWQKCmBgYAoKIyMjIENvcnJlY3QgZHVwbGljYXRlcwoKQ29ycmVjdCB0aGUgZHVwbGljYXRlcyBJIGNhbiBhbmQgZHJvcCB0aGUgb3RoZXJzIGZvciBub3cuIEZsYWcgdGhlIGR1cGxpY2F0ZWQgb25lcyBhbmQgc2F2ZSB0aGVtIHRvIHNoYXJlIHdpdGggTmF0aGFuaWVsLgoKVE9ETyhtYXR0bG93ZXMpIC0gc2hhcmUgYW55IHJlbWFpbmluZyBkdXBsaWNhdGVzIHdpdGggTmF0aGFuaWVsIGFuZCBzZWUgaWYgaGUgaGFzIGEgc29sdXRpb24uIEFsc28gc2VlIGlmIGhlIGNhbiB1bmRlcnN0YW5kIHdoeSB0aGlzIG1pZ2h0IGhhdmUgaGFwcGVuZWQgYW5kIGlmIHRoZXkgc2hvdWxkIGFjdHVhbGx5IGhhdmUgYSBkaWZmZXJlbnQgc2FtcGxlIGlkLgoKKiBzaGFyZSB0aGUgbWVyZ2VkIGRhdGEgZm9yIE5hdGhhbmllbCB0byBwdXQgaW50byBDQyAoaW5jbHVkZSB0aGUgZHVwbGljYXRlIGlkcykKCmBgYHtyfQpyIDwtIHIgJT4lIG11dGF0ZSgKICAgIGR1cCA9IGlmZWxzZSgKICAgICAgc2FtcGxlX2lkID09ICIxMiIgJiBjZWxsX2ZpZWxkID09ICJNVU5BTklSQSIgfAogICAgICBzYW1wbGVfaWQgPT0gIjEzNyIgJiB2aWxsYWdlID09ICJSdXN1bWEiIHwKICAgICAgc2FtcGxlX2lkID09ICIxNTAzIiAmIGZhcm1lcl9saXN0PT0iTkFLQUdJWkUgVmFsXFx4YzNcXHhhOXJpZSIgfAogICAgICAjc2FtcGxlX2lkID09ICIyMDQ0QyIgJiAgIyBzYW1lIQogICAgICBzYW1wbGVfaWQgPT0gIjIyNzgiICYgY2VsbF9maWVsZD09Ik5raXJhIEEiIHwgIyBjaGVjayB0aGlzIGFzIG1heWJlIHRoaXMgd2FzIHRoZSBvbmx5IHRoaW5nIHdyb25nPwogICAgICAjc2FtcGxlX2lkID09ICIyMjk5IiAmICMgc2FtZSEKICAgICAgc2FtcGxlX2lkID09ICIyNjEwIiAmIHZpbGxhZ2U9PSJhZ2FraXJpIiAjfCAgI2FnYWtpcmkgaXMgY2xvc2UgdG8gZ2FraXJpIGluIHNwZWxsaW5nLiBJcyB0aGlzIGp1c3QgYSB0eXBvPwogICAgICAjc2FtcGxlX2lkID09ICIyNjEyIiAmICAjIHNhbWUgbmFtZXMhCiAgICAgICNzYW1wbGVfaWQgPT0gIjI2MTJDIiAjIHNhbWUgbmFtZXMhCiAgICAgICwgMSwgMCkKKSAlPiUgZmlsdGVyKAogIGR1cCE9MQopICU+JSBkcGx5cjo6c2VsZWN0KC1kdXApIAoKIyBydW4gdGhpcyBjb2RlIGFnYWluIGZyb20gYWJvdmUgdG8gZ2V0IHVwZGF0ZWQgZHVwbGljYXRlcyBsaXN0CiNsZW5ndGgociRzYW1wbGVfaWQpPT1sZW5ndGgodW5pcXVlKHIkc2FtcGxlX2lkKSkKZHVwcyA8LSByJHNhbXBsZV9pZFtkdXBsaWNhdGVkKHIkc2FtcGxlX2lkKV0KZHVwSW5kZXggPC0gd2hpY2goZHVwbGljYXRlZChyJHNhbXBsZV9pZCkpCgojIGZvciB0aGUgdGltZSBiZWluZyBkcm9wIHRoZSBvYnNlcnZhdGlvbnMgdGhhdCBhcmUgZHVwbGljYXRlcwpyIDwtIHJbIXIkc2FtcGxlX2lkICVpbiUgZHVwcyxdCgpgYGAKCiMjIFJlc2hhcGUgdmFyaWFibGVzCgpUaGlzIHNob3VsZCBpbmNsdWRlIHRoZSBiYXNlbGluZSB2YXJpYWJsZXMgYXMgd2VsbC4KCkxldCdzIGZpcnN0IGNoZWNrIHdpdGggdGhlIGJhc2VsaW5lIGRhdGEgdG8gc2VlIHdoYXQgdmFyaWFibGVzIHdlIG1hZGUgdGhlcmUgc28gSSBjYW4gbWFrZSB0aGUgc2FtZSBvbmVzIGZyb20gdGhlIHJvdW5kIDEgZGF0YS4gVGhlcmUgYXJlIHNvbWUgdmFyaWFibGVzIHRoYXQgYXJlIGJhc2VsaW5lIHZhcmlhYmxlcyBvbmx5IGxpa2UgdmFyaWFibGVzIGFza2luZyBhYm91dCBoaXN0b3JpY2FsIHByYWN0aWNlcy4gVGhlcmUgYXJlIHRoZW4gb3RoZXIgdmFyaWFibGVzIHRoYXQgd2lsbCB2YXJ5IGJ5IHNlYXNvbi4gVGhlc2UgYXJlIHRoZSB2YXJpYWJsZXMgdGhhdCB3ZSB1bHRpbWF0ZWx5IHdhbnQgaW4gdG8gc2hhcGUgaW4gYSBsb25nIGRhdGFzZXQgYnkgc2Vhc29uIHRvIGFuYWx5emUgY2hhbmdlcyBvdmVydGltZSBpbiBwcmFjdGljZXMgYW5kIHNvaWwgbWFuYWdlbWVudC4gSSB0aGluayB0aGlzIHdpbGwgcmVzdWx0IGluIGEgZGF0YXNldCB0aGF0IGhhcyBvbmUgcm93IHBlciBmYXJtZXIgcGVyIHNlYXNvbi4gU29tZSB2YXJpYWJsZXMgbWF5IG5vdCBmaXQgbmljZWx5IGludG8gdGhpcyBidXQgd2UgY2FuIGRlYWwgd2l0aCB0aG9zZS4gRm9yIHZhcmlhYmxlcyB0aGF0IGFyZW4ndCBjaGFuZ2luZyBvdmVyIHRpbWUgdGhleSdsbCBzaG93IGFzIG5vdCBpbXBvcnRhbnQgaW4gb3VyIG1vZGVsLiBUaGV5J3JlIGltcG9ydGFudCBmb3IgbWF0Y2hpbmcgZmFybWVycy4KClRoZXJlIGFyZSBhIGxvdCBvZiB2YXJpYWJsZXMgdG8gdHJ5IHRvIGxpbmUgdXAuIFNvbWUgYWxyZWFkeSBoYXZlIHRoZSBzYW1lIG5hbWUgYnV0IGhvdyB0byBiZXN0IGNvbWJpbmUgdGhlIG9uZXMgdGhhdCBoYXZlIGRpZmZlcmVudCB2YXJpYWJsZSBuYW1lcz8gSSdtIGdvaW5nIHRvIHdyaXRlIGEgZnVuY3Rpb24gdGhhdCB0YWtlcyBhIHZhcmlhYmxlIG5hbWUgZnJvbSBgYmAgYW5kIGEgdmFyaWFibGUgbmFtZSBmcm9tIGByYCB0aGF0IHNob3VsZCBnbyB0b2dldGhlciwgdXBkYXRlcyB0aGUgYHJgIHZhcmlhYmxlIG5hbWUgYW5kIHVzZXMgdGhhdCBpbmZvIHRvIGByYmluZGAgdGhlIGRhdGEgaW50byBhIGxvbmcgZGF0YXNldC4KCmBgYHtyfQojIG5hbWVzKGIpCiMgbmFtZXMocikKCiMgY2hlY2sgdGhlIG5hbWVzIHRoYXQgYWxyZWFkeSBtYXRjaApiYXNlbGluZUZvdW5kIDwtIG5hbWVzKGIpW25hbWVzKGIpICVpbiUgbmFtZXMocildICMgbm90IG1hbnkgdmFyaWFibGUgbmFtZXMgYXJlIGFsaWduZWQKYGBgCgpVcGRhdGUgdmFyaWFibGUgbmFtZXMgc28gdGhhdCBhbnkgdmFyaWFibGUgd2l0aCAxNmEgb3IgMTZiIGhhcyBhIHRoZSBgYWAgb3IgYGJgIHNlYXNvbiBkZXNpZ25hdGlvbiBhdCB0aGUgZW5kIGl0IHNvIEkgY2FuIHJlcGxpY2F0ZSB0aGUgYGdhdGhlcigpYCBhbmQgYHNwcmVhZCgpYCBvcHRpb25zIGZvciByZW9yZ2FuaXppbmcgdGhlIGRhdGEgYnkgc2Vhc29uIGFuZCBieSBwbG90LiBUaGlzIG1lYW5zIHRoYXQgdGhlIHZhcmlhYmxlIG5hbWVzIHdpbGwgcmV0YWluIHRoZWlyIGRlc2lnbmF0aW9uIG9mIGZpcnN0IG9yIHNlY29uZCBhcHBsaWNhdGlvbiBhbmQgYmUgZGlzdGluZ3Vpc2hhYmxlLgoKVE9ETyhtYXR0bG93ZXMpIC0gcmVuYW1lIHRoZSB2YXJpYWJsZXMgYWNjb3JkaW5nIHRvIHRoYXQgY29udmVudGlvbiB0byByZXNoYXBlIHRoZSBgcmAgZGF0YS4gS2VlcCB0aGUgYmFzZWxpbmUgZGF0YSBpbiBtaW5kIGFzIHdlJ2xsIHdhbnQgdG8gZG8gdGhlIHNhbWUgdGhpbmcgd2l0aCB0aGUgYmFzZWxpbmUgZGF0YSB0byBtYWtlIHRoZW0gbWF0Y2guCgpgYGB7cn0KciA8LSByICU+JSByZW5hbWUoCiAgd2hpY2hfY3JvcF8xXzE2YSA9IHdoaWNoX2Nyb3BfMTZhXzEsCiAgd2hpY2hfbWFpemVfc2VlZF8xXzE2YSA9IHdoaWNoX21haXplX3NlZWRfMTZhXzEsCiAgd2hpY2hfY3JvcF8yXzE2YSA9IHdoaWNoX2Nyb3BfMTZhXzIsCiAgd2hpY2hfbWFpemVfc2VlZF8yXzE2YSA9IHdoaWNoX21haXplX3NlZWRfMTZhXzIsCiAga2dfc2VlZF92ZWdfMV8xNmEgPSBrZ19zZWVkX3ZlZ18xNmFfMSwKICBrZ19zZWVkXzFfMTZhID0ga2dfc2VlZF8xNmFfMSwKICBrZ19zZWVkXzJfMTZhID0ga2dfc2VlZF8xNmFfMiwKICBrZ195aWVsZF8xXzE2YSA9IGtnX3lpZWxkXzE2YV8xLAogIGtnX3lpZWxkXzJfMTZhID0ga2dfeWllbGRfMTZhXzIsCiAgeWllbGRfY29tcGFyZV8xXzE2YSA9IHlpZWxkX2NvbXBhcmVfMTZhXzEsCiAgeWllbGRfY29tcGFyZV8yXzE2YSA9IHlpZWxkX2NvbXBhcmVfMTZhXzIsCiAgCiAgd2hpY2hfY3JvcF8xXzE2YiA9IHdoaWNoX2Nyb3BfMTZiXzEsCiAgd2hpY2hfbWFpemVfc2VlZF8xXzE2YiA9IHdoaWNoX21haXplX3NlZWRfMTZiXzEsCiAgd2hpY2hfY3JvcF8yXzE2YiA9IHdoaWNoX2Nyb3BfMTZiXzIsCiAgd2hpY2hfbWFpemVfc2VlZF8yXzE2YiA9IHdoaWNoX21haXplX3NlZWRfMTZiXzIsCiAgI2tnX3NlZWRfdmVnXzFfMTZhID0ga2dfc2VlZF92ZWdfMTZhXzEsCiAgI2tnX3NlZWRfYW5hbmFzXzJfMTZhID0ga2dfc2VlZF9hbmFuYXNfMTZhXzIsCiAgI2tnX3NlZWRfaHdhZ18xXzE2YSA9IGtnX3NlZWRfaHdhZ18xNmFfMSwKICBrZ19zZWVkXzFfMTZiID0ga2dfc2VlZF8xNmJfMSwKICBrZ19zZWVkXzJfMTZiID0ga2dfc2VlZF8xNmJfMiwKICBrZ195aWVsZF8xXzE2YiA9IGtnX3lpZWxkXzE2Yl8xLAogIGtnX3lpZWxkXzJfMTZiID0ga2dfeWllbGRfMTZiXzIsCiAgeWllbGRfY29tcGFyZV8xXzE2YiA9IHlpZWxkX2NvbXBhcmVfMTZiXzEsCiAgeWllbGRfY29tcGFyZV8yXzE2YiA9IHlpZWxkX2NvbXBhcmVfMTZiXzIKKQoKCgphU2Vhc29uIDwtIG5hbWVzKHIpW2dyZXAoIigxLmEpIiwgbmFtZXMocikpXQpiU2Vhc29uIDwtIG5hbWVzKHIpW2dyZXAoIigxLmIpIiwgbmFtZXMocikpXQpzZWFzb25hbFZhcnMgPC0gYyhhU2Vhc29uLCBiU2Vhc29uLCAic2FtcGxlX2lkIikKZmFybWVyVmFycyA8LSBjKG5hbWVzKHIpWyFuYW1lcyhyKSAlaW4lIHNlYXNvbmFsVmFyc10sICJzYW1wbGVfaWQiKQpgYGAKCmBgYHtyfQojIGV4YW1wbGUgZGF0YQojIGRmIDwtIGRhdGEuZnJhbWUoCiMgICBpZCA9IDE6MTAsCiMgICB0aW1lID0gYXMuRGF0ZSgnMjAwOS0wMS0wMScpICsgMDo5LAojICAgUTMuMi4xLiA9IHJub3JtKDEwLCAwLCAxKSwKIyAgIFEzLjIuMi4gPSBybm9ybSgxMCwgMCwgMSksCiMgICBRMy4yLjMuID0gcm5vcm0oMTAsIDAsIDEpLAojICAgUTMuMy4xLiA9IHJub3JtKDEwLCAwLCAxKSwKIyAgIFEzLjMuMi4gPSBybm9ybSgxMCwgMCwgMSksCiMgICBRMy4zLjMuID0gcm5vcm0oMTAsIDAsIDEpCiMgKQojIAojIGRmICU+JQojICAgZ2F0aGVyKGtleSwgdmFsdWUsIC1pZCwgLXRpbWUpICU+JQojICAgZXh0cmFjdChrZXksIGMoInF1ZXN0aW9uIiwgImxvb3BfbnVtYmVyIiksICIoUS5cXC4uKVxcLiguKSIpICU+JQojICAgc3ByZWFkKHF1ZXN0aW9uLCB2YWx1ZSkKYGBgCgpgYGB7cn0KCiMgYURhdCA8LSByWyxuYW1lcyhyKSAlaW4lIGFTZWFzb25dICMgd29ya3MgZm9yIHRoaXMgdG9vIQojIGFEYXQgPC0gYURhdFssZ3JlcCgiMTZhXzEiLCBuYW1lcyhhRGF0KSldICMgd29ya3MgZm9yIHRoaXMKYURhdCA8LSByWyxuYW1lcyhyKSAlaW4lIHNlYXNvbmFsVmFyc10gIyB3b3JrcyBmb3IgdGhpcyEKCiNodHRwOi8vc3RhY2tvdmVyZmxvdy5jb20vcXVlc3Rpb25zLzI1OTI1NTU2L2dhdGhlci1tdWx0aXBsZS1zZXRzLW9mLWNvbHVtbnMKc2Vhc29uYWxEYXQgPC0gYURhdCAlPiUKICBnYXRoZXIoa2V5LCB2YWx1ZSwgLXNhbXBsZV9pZCkgJT4lCiAgdGlkeXI6OmV4dHJhY3Qoa2V5LCBjKCJ2YXJpYWJsZSIsICJzZWFzb24iKSwgIiheLipcXF8xLikoLikiKSAlPiUKICBtdXRhdGUoc2Vhc29uID0gcGFzdGUwKCIxNiIsIHNlYXNvbikpICU+JSAKICBzcHJlYWQodmFyaWFibGUsIHZhbHVlKQoKbmFtZXMoc2Vhc29uYWxEYXQpIDwtIGdzdWIoIl8xNiIsICIiLCBuYW1lcyhzZWFzb25hbERhdCkpCgpgYGAKClRPRE8obWF0dGxvd2VzKSAtIGNvbmZpcm0gdGhhdCB0aGUgdGlkeXIgcHJvY2VzcyB3b3JrZWQgYXMgSSBleHBlY3RlZCBhcyB0aGVyZSBhcmUgbnVtZXJvdXMgbWlzc2luZyB2YWx1ZXMuIFRoZXNlIHNlZW0gdG8gYXBwZWFyIHdoZXJlIHRoZSB2YXJpYWJsZSBvbmx5IGhhZCBvbmUgdmVyc2lvbiBvZiB0aGUgdmFyaWFibGUsIF8xNiwgcmF0aGVyIHRoYW4gYSBfMTZhIGFuZCBhIF8xNmIuIENoZWNrIG91dCBob3cgdGhpcyBpcyBoYW5kbGluZyB2YXJpYWJsZXMgd2l0aCBfMTcgaW5zdGVhZCBvZiBfMTYuCgojIyBNZXJnZSBzZWFzb25hbCBhbmQgZGVtb2dyYXBoaWMgZGF0YQoKYGBge3J9CnJzIDwtIGxlZnRfam9pbihzZWFzb25hbERhdCwgclssYyhuYW1lcyhyKVshbmFtZXMocikgJWluJSBzZWFzb25hbFZhcnNdLCJzYW1wbGVfaWQiKV0sIGJ5PSJzYW1wbGVfaWQiKQpgYGAKCiMjIENvbWJpbmUgbG9uZyB3aXRoIGJhc2VsaW5lCgpUaGUgYG1hdGNoUm91bmRzYCBmdW5jdGlvbiB1cGRhdGVzIHZhcmlhYmxlIG5hbWVzIGFjcm9zcyByb3VuZHMgYW5kIHJlcG9ydHMgdGhlIGluZGV4IGFuZCBuZXcgbmFtZSBvZiB0aGUgdmFyaWFibGVzLiBJIGNhbiB0aGVuIHRha2UgdGhlIGZpcnN0IHBhcnQgb2YgdGhlIGxpc3QgZm9yIGBkYXQxYCBhbmQgdGhlIHNlY29uZCBwYXJ0IGZvciBgZGF0MmAuCgpPciBqdXN0IGNoYW5nZSBiYXNlbGluZSB2YXJpYWJsZSBuYW1lcyBtYW51YWxseS4gV2hhdCdzIHRoZSBiZXN0IHdheSB0byBkbyB0aGlzPyBGaXJzdCByZXNoYXBlIHRoZSBiYXNlbGluZSB2YXJpYWJsZXMgdG8gYmUgcGxvdCBsZXZlbCBhcyB3ZWxsIHdpdGggYSBzZWFzb24gaW5kaWNhdG9yLiAKClRPRE8obWF0dC5sb3dlcykgQ29uZmlybSB0aGF0IHRoaXMgaXMgbmVjZXNzYXJ5LiBJZiB0aGUgYmFzZWxpbmUgZGF0YSBvbmx5IGluY2x1ZGVzIHRoZSBwcmV2aW91cyBzZWFzb24gYW5kIHRoZSBoaXN0b3J5IHRoZW4gdGhlIHJlc2hhcGUgbWF5IG5vdCBiZSBuZWNlc3NhcnkuIEFsbCBzdWJzZXF1ZW50IHN1cnZleXMgYXNrZWQgYWJvdXQgdHdvIHNlYXNvbnMsIHRoZSBpbnRlcnZlbmluZyBzZWFzb24gYW5kIHRoZSByZWxldmFudCBzZWFzb24uIEdldCB5b3VyIGhlYWQgYXJvdW5kIHRoZSBiYXNlbGluZSBkYXRhIGFnYWluIGFuZCBhY3QuCgpgYGB7cn0KIyBiIDwtIGIgJT4lIHJlbmFtZSgKIyAgIGlucHV0dXNlX3ByaW9yZF9mZXJ0aWxpemVyXzE1YiA9IGlucHV0dXNlXzE1Yl9wcmlvcmRfZmVydGlsaXplciwKIyAgIGlucHV0dXNlX3ByaW9yY3VsdHVyZV8xNWJfMSA9IGlucHV0dXNlXzE1Yl9wcmlvcmN1bHR1cmVfMTViXzEsCiMgICBpbnB1dHVzZV9wcmlvcmRfaW50ZXJjcm9wXzE1YiA9IGlucHV0dXNlXzE1Yl9wcmlvcmRfaW50ZXJjcm9wXzE1YiwKIyAgIGlucHV0dXNlX3ByaW9yY3VsdHVyZV9pbl8xNWIgPSBpbnB1dHVzZV8xNWJfcHJpb3JjdWx0dXJlXzE1Yl9pbiwKIyAgIGNyb3AxX3NlZXR5XzE1YiA9IGNyb3AxXzE1Yl9zZWVkdHksCiMgICAjdjU4CiMgICBjcm9wMV95aWVsZF8xNWIgPSBjcm9wMV8xNWJfeWllbGQsCiMgICBjcm9wMV95aWVsZF9fMTViID0gY3JvcDFfMTViX3lpZWxkXywKIyAgIGNyb3AyX3NlZWR0eV8xNWIgPSBjcm9wMl8xNWJfc2VlZHR5LAojICAgIzYzCiMgICBjcm9wMl9zZWVka2dfMTViID0gY3JvcDJfMTViX3NlZWRrZywKIyAgIGNyb3AyX3lpZWxkXzE2YiA9IGNyb3AyXzE1Yl95aWVsZCwKIyAgIGNyb3AyX3lpZWxkX18xNWIgPSBjcm9wMl8xNWJfeWllbGRfLAojICAgZmllbGRfZmVydF90XzE1YiA9IGZpZWxkXzE1Yl9mZXJ0X3QsCiMgICAjdjY5CiMgICBmaWVsZF9jb21wb3N0X3F1XzE1YiA9IGZpZWxkX2NvbXBvc3RfcXUKIyApCgpgYGAKCkkgdGhpbmsgdGhhdCBhbGwgbmVlZHMgdG8gYmUgZG9uZSBpcyB0byBhZGQgYSBzZWFzb24gdmFyaWFibGUgYW5kIHJlbmFtZSB0aGUgYmFzZWxpbmUgdmFyaWFibGVzIHRvIHRha2Ugb2ZmIHRoZSBgXzE1YmAgcG9ydGlvbi4KCmBgYHtyfQp3cml0ZS5jc3YobmFtZXMoYiksICJiYXNlbGluZVZhcnMuY3N2Iiwgcm93Lm5hbWVzID0gVCkKd3JpdGUuY3N2KG5hbWVzKHJzKSwgInJvdW5kMVZhcnMuY3N2Iiwgcm93Lm5hbWVzID0gVCkKCm5hbWVzKGIpIDwtIGdzdWIoIl8xNWIiLCAiIiwgbmFtZXMoYikpCmIkc2Vhc29uIDwtICIxNWIiCgpiIDwtIGIgJT4lIHJlbmFtZSgKICAgICAgY3JvcDFfbG9jYWwgPSB2NTgsCiAgICAgIGNyb3AyX2xvY2FsID0gdjYzLAogICAgICBmaWVsZF9mZXJ0X3RfMSA9IGZpZWxkX2ZlcnRfdCwKICAgICAgZmllbGRfZmVydF90XzIgPSB2NjkKICAgICkKYGBgCgoKVE9ETyAtIGl0IGFsc28gc2VlbXMgdG8gdGhlIGNhc2UgdGhhdCBzb21lIG9mIHRoZSBzZWVkIHR5cGUgdmFyaWFibGVzIGFyZSBtaXhlZCB1cCBpbiBgcmAgYW5kIGByc2AuIFNlZSB3aGF0IHRoZSBpc3N1ZSBpcy4gRWFjaCBwbG90IHNob3VsZCBoYXZlIG9ubHkgb25lIGFuc3dlciBmb3IgdGhvc2UuCgpNQUpPUiBUT0RPOiBjb25maXJtIHRoYXQgSSdtIG5vdCBkdXBsaWNhdGluZyB0aGUgc29pbCBkYXRhIGJ5IGFzc2lnbmluZyBpdCB0byBib3RoIG9mIHRoZSBzZWFzb25zIHdlIGFza2VkIGFib3V0IGluIHRoZSBmb2xsb3cgdXAgc3VydmV5IChJIHRoaW5rIEkgY3VycmVudGx5IGFtIDYvMTUvMTcpLiBXZSB3YW50IHRvIGFjY291bnQgZm9yIGZpZWxkIG1hbmFnZW1lbnQgaW4gdGhlIGludGVydmVuaW5nIHNlYXNvbiBidXQgKip3ZSBkb24ndCB3YW50IHRvIGFzc3VtZSB0aGUgc29pbCBvdXRjb21lIGlzIHRoZSBzYW1lIGZvciBib3RoIHNlYXNvbnMuIFNwZWNpZmljYWxseSwgdGhpcyBtZWFucyB0aGUgMTZhIHNlYXNvbioqCgpUT0RPIC0gYWRkIHRoZSBgb25seVIxYCB2YXJpYWJsZXMgYmFjayBpbnRvIHRoZSBkYXRhIHNvIHdlIGhhdmUgZmllbGQgdGV4dHVyZS4KCioqTm90ZSoqOiB0aGUgZmluYWwgbG9uZyBkYXRhIGJ5IHBsb3Qgc2hvdWxkIGhhdmUgb25seSBvbmUgb2JzZXJ2YXRpb24gZm9yIHN0YXRpb25hcnkgdmFyaWFibGVzIGxpa2Ugc2xvcGUgb3IgaGlzdG9yaWNhbCBpbmZvcm1hdGlvbgoKYGBge3J9CiMgaSdtIHVwZGF0aW5nIGJhc2VsaW5lIG5hbWVzIHRvIG1hdGNoIHJvdW5kIDEgbmFtZXMuIApiVXBkYXRlIDwtIGIgJT4lIAogIG11dGF0ZSgKICAgIGRfY29tcG9zdCA9IGlmZWxzZShmaWVsZF9rZ19jb21wb3N0ID4gMCwgMSwgMCkKICApICU+JQogIHJlbmFtZSgKICB0YWJsZXQgPSBkZW1vZ3JhcGhpY2lkX3RhYmxldCwKICB2aWxsYWdlID0gdW11ZHVndWR1LAogIG5faG91c2Vob2xkID0gaGhzaXplLAogIG5fdHVidXJhX3NlYXNvbiA9IHRvdGFsLnNlYXNvbnMsCiAgZmllbGRfbGVuZ3RoID0gZmllbGRfZGltMSwgIyBJJ20gYXNzdW1pbmcgZGltMSBpcyBsZW5ndGguIGl0IG1pZ2h0IG5vdCBiZS4gSXQgbWlnaHQgbm90IG1hdHRlci4KICBmaWVsZF93aWR0aCA9IGZpZWxkX2RpbTIsCiAgbl9zcG90cyA9IG5fc3BvdHNfYywKICBrZ19zZWVkXzEgPSBjcm9wMV9zZWVka2csCiAga2dfc2VlZF8yID0gY3JvcDJfc2VlZGtnLAogIGZlcnRfa2cxID0gZmllbGRfa2dfZmVydDEsCiAgZmVydF9rZzIgPSBmaWVsZF9rZ19mZXJ0MiwKICBrZ195aWVsZF8xID0gY3JvcDFfeWllbGQsCiAga2dfeWllbGRfMiA9IGNyb3AyX3lpZWxkLAogIGtnX2NvbXBvc3QgPSBmaWVsZF9rZ19jb21wb3N0LAogIGRfY2xpZW50ID0gY2xpZW50LAogIGNlbGxfZmllbGQgPSBjZWxsdWxlX2ZpZWxkLAogIGZlcnRfdHlwZTEgPSBmaWVsZF9mZXJ0X3RfMSwKICBmZXJ0X3R5cGUyID0gZmllbGRfZmVydF90XzIsCiAgWC5Ub3RhbC5OaXRyb2dlbiA9IFRvdGFsLk5pdHJvZ2VuLAogIFguU29kaXVtID0gU29kaXVtLAogIFguT3JnYW5pYy5DYXJib24gPSBPcmdhbmljLkNhcmJvbiwKICBYLkVDLi5TYWx0cy4gPSBFQy4uU2FsdHMuLAogIFguQy5FLkMgPSBDLkUuQywKICBYLkV4Y2hhbmdlYWJsZS5BY2lkaXR5ID0gRXhjaGFuZ2VhYmxlLkFjaWRpdHksCiAgWC5FeGNoYW5nZWFibGUuQWx1bWluaXVtID0gRXhjaGFuZ2VhYmxlLkFsdW1pbml1bSwKICBYLlBob3NwaG9ydXMuU29ycHRpb24uSW5kZXguLlBTSS4gPSBBY2lkLlNhdHVyYXRpb24sICMgY2hlY2sgdGhhdCB0aGlzIGlzIHJpZ2h0CiAgbl9jb3dzID0gYmV0YWlsX293bmVkbl9pbmthLAogIG5fZ29hdHMgPSBiZXRhaWxfb3duZWRuX2loZW5lLAogIG5fY2hpY2tlbnMgPSBiZXRhaWxfb3duZWRuX2lua29rbywKICBuX3BpZ3MgPSBiZXRhaWxfb3duZWRuX2luZ3VydWJlLAogIG5fc2hlZXAgPSBiZXRhaWxfb3duZWRuX2ludGFtYSwKICBkYXRlID0gZGVtb2dyYXBoaWNkYXRlLAogIGZpZWxkX3Nsb3BlID0gZ2VuZXJhbF9maWVsZF9pbmZvZ3JhZGVfaGlsbCwKICBmaWVsZF9lcm9zaW9uID0gZ2VuZXJhbF9maWVsZF9pbmZvYW50aWVyb3Npb25fZWYsCiAgdHlwZV9jb21wb3N0ID0gZmllbGRfdHlwZV9jb21wbywKICBxdWFsaXR5X2NvbXBvc3QgPSBmaWVsZF9jb21wb3N0X3F1LAogIGRfc2FtcGxlID0gc2FtcGxlLAogIGVudW1fbmFtZSA9IHN1cnZleW9yLAogIGhvd191c2VfcmVzaWR1ZXMgPSBhY3Rpb25fY3JvcHJlc2lkCikKCiMgYmlvZ3JhcGhpY2FsIHZhcmlhbGVzIHRoYXQgYXBwbHkgdG8gYWN0aW9ucyBpbiB0aGUgYmFzZWxpbmUgYmVmb3JlIHRoZSBzdHVkeSBzdGFydGVkCmJpb1ZhcnMgPC0gYlVwZGF0ZSAlPiUgZHBseXI6OnNlbGVjdCgKICBuX3NlYXNvbl9mZXJ0LCBub2ZlcnRfd2h5LCBuX3NlYXNvbl9jb21wb3N0LCBub2NvbXBvc3Rfd2h5LCBuX3NlYXNvbl9saW1lLCBub2xpbWVfd2h5LAogIG5fc2Vhc29uX2ZhbGxvdywgbl9zZWFzb25zX2xlZ18xLCBuX3NlYXNvbnNfbGVnXzIsIGFleiwgY29udGFpbnMoImRfc2Vhc29uX2xpc3RkXyIpLAogIGNvbnRhaW5zKCJpbnB1dHVzZV9wcmlvciIpCikKCmJWYXJzIDwtIG5hbWVzKGJVcGRhdGUpWyFuYW1lcyhiVXBkYXRlKSAlaW4lIG5hbWVzKGJpb1ZhcnMpXSAjIHJlbW92ZSBiaW9ncmFwaGljYWwgdmFycwoKIyBvcmdhbml6YXRpb25hbCB2YXJpYWJsZXMgdG8gYmUgaWdub3JlZApvcmdWYXJzIDwtIGJVcGRhdGUgJT4lCiAgZHBseXI6OnNlbGVjdCgKICAgIGZpZWxkY29sbGVjdGlvbmRhdGUsIGRhdGVjb2xsZWN0ZWRpbmRpc3RyaWN0LCBkYXRlc2VudHRvaHEsIGRhdGVyZWNlaXZlZGF0aHEsCiAgICBwcm9jZXNzZWRhdGhxXywgcGFja2VkZm9yc2VuZGluZ3Rva2VueWFfLCBkYXRlZmluaXNoZWRwcm9jZXNzaW5nCiAgKQoKYlZhcnMgPC0gYlZhcnNbIWJWYXJzICVpbiUgbmFtZXMob3JnVmFycyldCgojIHZhcmlhYmxlcyB0aGF0IG9ubHkgYXBwZWFyIGluIHRoZSByb3VuZCAxIGRhdGEgPj4gbGlrZWx5IHdhbnQgdG8ga2VlcCB0aGVzZSBhbmQgbWFrZSB0aGVtIHBhcnQgb2YgdGhlICJzdGFibGUiIGlkZW50aWZ5aW5nIGRhdGEKb25seVIxIDwtIHJzICU+JQogIGRwbHlyOjpzZWxlY3QoCiAgICBmaWVsZF9uX2Nyb3BzLCBjcm9wX2RpcmVjdGlvbiwgZmllbGRfdGV4dHVyZSwgc2FtcGxlX2lkCiAgKQoKcjFWYXJzIDwtIG5hbWVzKHJzKVshbmFtZXMocnMpICVpbiUgbmFtZXMob25seVIxKV0KCiMgY2hlY2sgd2hhdCdzIGFscmVhZHkgdGhlIHNhbWUKbWF0Y2hOYW1lcyA8LSByMVZhcnNbcjFWYXJzICVpbiUgYlZhcnNdICMgdGhlc2UgYXJlIHRoZSBtYXRjaGVzIHdlJ3JlIGdldHRpbmcKIyBtYXRjaE5hbWVzCgojIGNoZWNrIHdoYXQgaXNuJ3QgYWNjb3VudGVkIGZvciBzb21laG93CnVubWF0Y2hlZEIgPC0gYlZhcnNbIWJWYXJzICVpbiUgcjFWYXJzXSAjIHVubWF0Y2hlZCBiYXNlbGluZSBtaW51cyBkZW1vZ3JhcGhpYyB2YXJzCnVubWF0Y2hlZFJzIDwtIHIxVmFyc1shcjFWYXJzICVpbiUgYlZhcnNdICMgdW5tYXRjaGVkIHIxCmBgYAoKTWFrZSB0aGUgc2FtcGxlIGlkIGxvd2VyIGNhc2UKCmBgYHtyfQpiVXBkYXRlJHNhbXBsZV9pZCA8LSB0b2xvd2VyKGJVcGRhdGUkc2FtcGxlX2lkKQpycyRzYW1wbGVfaWQgPC0gdG9sb3dlcihycyRzYW1wbGVfaWQpCmBgYAoKCiMjIE1lcmdlIGRlbW9ncmFwaGljIHZhcmlhYmxlcwoKKiBJZGVudGlmeSBkZW1vZ3JhcGhpYyBhbmQgaGlzdG9yaWNhbCB2YXJpYWJsZXMgaW4gYGJgCiogSWRlbnRpZnkgYW55IG5ldyBkYXRhIGZyb20gUjEgbm90IGluIHRoZSBiYXNlbGluZSBhbmQgbWVyZ2UgdGhlbSBpbgoqIEknbSB1c2luZyBgYlVwZGF0ZWAgYXMgaXQncyB0aGUgbW9zdCB1cCB0byBkYXRlIGFuZCBzaW1wbGlmaWVzIHVwZGF0aW5nIHRoZSBzY3JpcHQuCgpgYGB7cn0KYkRlbW8gPC0gYlVwZGF0ZSAlPiUgCiAgZHBseXI6OnNlbGVjdCgKICBTU04sIGRpc3RyaWN0LCBjZWxsX2ZpZWxkLCB2aWxsYWdlLCBzYW1wbGVfaWQsICAKICBuX3NlYXNvbl9mZXJ0LCBub2ZlcnRfd2h5LCBuX3NlYXNvbl9jb21wb3N0LCBub2NvbXBvc3Rfd2h5LCBuX3NlYXNvbl9saW1lLCBub2xpbWVfd2h5LAogIG5fc2Vhc29uX2ZhbGxvdywgbl9zZWFzb25zX2xlZ18xLCBuX3NlYXNvbnNfbGVnXzIsIGFleiwgY29udGFpbnMoImRfc2Vhc29uX2xpc3RkXyIpLAogIGNvbnRhaW5zKCJpbnB1dHVzZV9wcmlvciIpCikKYGBgCgojIyBBcHBlbmQgZmllbGQvc29pbCB2YXJpYWJsZXMKCiogYHJiaW5kYCBSMSBmaWVsZCBsZXZlbCB2YXJpYWJsZXMgd2l0aCBgYmAgZmllbGQgbGV2ZWwgdmFyaWFibGVzIHRvIG1ha2UgYSBwbG90IGxldmVsIGRhdGFzZXQuIAoqIFNlbGVjdCBvbmx5IHRoZSB2YXJpYWJsZXMgSSB3YW50IHRvIGtlZXAKKiBHZW5lcmF0ZSBhbnkgbmV3IG91dGNvbWVzIHRoYXQgYnJpbmcgdGhlIGRhdGEgZG93biB0byBhIHNpbmdsZSBvdXRjb21lLCByYXRoZXIgdGhhbiBvbmUgYnkgcGxvdCAqKmFuZCBzZWFzb24qKi4KKiBJIGNhbiB0aGVuIG1ha2UgbG9uZ2l0dWRpbmFsIG91dGNvbWVzIGZyb20gdGhvc2UgZGF0YSBhbmQgbWVyZ2UgdGhvc2UgaW50byB0aGUgZGVtb2dyYXBoaWMgZGF0YQoqICoqUHV0IGluIHZhcmlhYmxlIGhlcmUgdGhhdCBtYXJrcyB3aGV0aGVyIHRoZSBmYXJtZXIgcmV0YWluZWQgdGhlaXIgdHJlYXRtZW50IHN0YXR1cyBmcm9tIHRoZSBiYXNlbGluZSoqCgpgYGB7cn0KY29tbW9uVmFycyA8LSBuYW1lcyhycylbbmFtZXMocnMpICVpbiUgbmFtZXMoYlVwZGF0ZSldICMgdXNpbmcgcnMgYmVjYXVzZSBpIGNoYW5nZWQgYmFzZWxpbmUgbmFtZXMgdG8gcnMgbmFtZXMKCmZpZWxkRGF0IDwtIHJiaW5kKGJVcGRhdGVbLGNvbW1vblZhcnNdLCByc1ssY29tbW9uVmFyc10pICMgY29tYmluZSBiYXNlbGluZSBhbmQgcm91bmQgMQoKIyBhZGQgYmFjayBpbiB0aGUgb25seVIxIHZhcmlhYmxlcyB0aGF0IHdlIHdhbnQgdG8gaGF2ZQoKYGBgCgpgc29pbERhdGAgaXMgdGhlIG9iamVjdCB0aGF0IGhhcyB0aGUgc29pbCB2YXJpYWJsZXMgZm9yIHNvaWwgc3BlY2lmaWMgYW5hbHlzZXMuIFlvdSBjYW4gZ2V0IHRvIGZpZWxkIG9ic2VydmF0aW9ucyB3aXRoIHNvaWwgb2JzZXJ2YXRpb25zIGJ5IGRyb3BwaW5nIHRoZSBBIHNlYXNvbiBkYXRhIHBvaW50cy4KCmBgYHtyfQpzb2lsRGF0IDwtIGZpZWxkRGF0ICU+JSAKICBkcGx5cjo6c2VsZWN0KG9uZV9vZihzb2lsVmFycyksIFNTTiwgc2Vhc29uLCBzYW1wbGVfaWQsIGRfY2xpZW50KSAlPiUKICBmaWx0ZXIoc2Vhc29uIT0iMTZhIikgIyBkcm9wcGluZyB0aGUgMTZhIHZhbHVlcyBhcyB0aGVzZSBhcmVuJ3QgdHJ1ZSBtZWFzdXJlbWVudHMgYnV0IGEgcmVzdWx0IG9mIHJlc2hhcGluZyB0aGUgcm91bmQgMSBkYXRhLgoKZmllbGRTb2lsRGF0IDwtIGZpZWxkRGF0ICU+JQogIGZpbHRlcihzZWFzb24hPSIxNmEiKQpgYGAKCiMjIENyZWF0ZSBuZXcgdmFyaWFibGVzCgojIyMgRmllbGQgdmFyaWFibGVzCgpJIG9yaWdpbmFsbHkgbWFkZSB0aGVzZSBuZXcgb3V0Y29tZXMgZm9yIGp1c3QgdGhlIHJvdW5kIDEgZGF0YSBidXQgSSByZWFsbHkgd2FudCB0byBoYXZlIGNvbW1vbiBvdXRwdXRzIGZvciBwbG90cyBieSBzZWFzb25zIHRoYXQgSSBjYW4gdGhlbiB0dXJuIGludG8gbG9uZ2l0dWRpbmFsIG91dGNvbWVzLiAKCmBgYHtyfQpmaWVsZERhdCRkaW0gPC0gZmllbGREYXQkZmllbGRfbGVuZ3RoICogZmllbGREYXQkZmllbGRfd2lkdGgKZmllbGREYXQkYXJlIDwtIGZpZWxkRGF0JGRpbS8xMDAKCgppbnB1dFZhcnMgPC0gbmFtZXMoZmllbGREYXQpW2dyZXAoImZlcnRffHF1YWxpdHlfY29tcG9zdHx0eXBlX2NvbXBvc3R8d2hpY2hfY3JvcHx3aGljaF9tYWl6ZSIsIG5hbWVzKGZpZWxkRGF0KSldCgpmaWVsZERhdFssaW5wdXRWYXJzXSA8LSBzYXBwbHkoZmllbGREYXRbLCBpbnB1dFZhcnNdLCB0b2xvd2VyKQoKIyBpbnB1dCBxdWFuaXRpdGVzCmZpZWxkRGF0JGZlcnRfa2dfdXJlYTEgPC0gaWZlbHNlKGZpZWxkRGF0JGZlcnRfdHlwZTE9PSJ1cmVhIiwgZmllbGREYXQkZmVydF9rZzEsIE5BKQpmaWVsZERhdCRmZXJ0X2tnX3VyZWEyIDwtIGlmZWxzZShmaWVsZERhdCRmZXJ0X3R5cGUyPT0idXJlYSIsIGZpZWxkRGF0JGZlcnRfa2cyLCBOQSkKZmllbGREYXQkZmVydF90b3RhbF91cmVhIDwtIGFwcGx5KGZpZWxkRGF0WywgZ3JlcCgiKHVyZWEuKSIsIG5hbWVzKGZpZWxkRGF0KSldLCAxLCBmdW5jdGlvbih4KXsKICBzdW0oYXMubnVtZXJpYyh4KSwgbmEucm09VCl9KQoKCgpmaWVsZERhdCRmZXJ0X2tnX2RhcDEgPC0gaWZlbHNlKGZpZWxkRGF0JGZlcnRfdHlwZTE9PSJkYXAiLCBmaWVsZERhdCRmZXJ0X2tnMSwgTkEpCmZpZWxkRGF0JGZlcnRfa2dfZGFwMiA8LSBpZmVsc2UoZmllbGREYXQkZmVydF90eXBlMj09ImRhcCIsIGZpZWxkRGF0JGZlcnRfa2cyLCBOQSkKZmllbGREYXQkZmVydF90b3RhbF9kYXAgPC0gYXBwbHkoZmllbGREYXRbLCBncmVwKCIoZGFwLikiLCBuYW1lcyhmaWVsZERhdCkpXSwgMSwgZnVuY3Rpb24oeCl7CiAgc3VtKGFzLm51bWVyaWMoeCksIG5hLnJtPVQpfSkKCgoKZmllbGREYXQkZmVydF9rZ18xN25wazEgPC0gaWZlbHNlKGZpZWxkRGF0JGZlcnRfdHlwZTE9PSJucGstMTciLCBmaWVsZERhdCRmZXJ0X2tnMSwgTkEpCmZpZWxkRGF0JGZlcnRfa2dfMTducGsyIDwtIGlmZWxzZShmaWVsZERhdCRmZXJ0X3R5cGUyPT0ibnBrLTE3IiwgZmllbGREYXQkZmVydF9rZzIsIE5BKQpmaWVsZERhdCRmZXJ0X3RvdGFsXzE3bnBrIDwtIGFwcGx5KGZpZWxkRGF0WywgZ3JlcCgiKDE3bnBrLikiLCBuYW1lcyhmaWVsZERhdCkpXSwgMSwgZnVuY3Rpb24oeCl7CiAgc3VtKGFzLm51bWVyaWMoeCksIG5hLnJtPVQpfSkKCgoKZmllbGREYXQkZmVydF9rZ18yMm5wazEgPC0gaWZlbHNlKGZpZWxkRGF0JGZlcnRfdHlwZTE9PSJucGstMjIiLCBmaWVsZERhdCRmZXJ0X2tnMSwgTkEpCmZpZWxkRGF0JGZlcnRfa2dfMjJucGsyIDwtIGlmZWxzZShmaWVsZERhdCRmZXJ0X3R5cGUyPT0ibnBrLTIyIiwgZmllbGREYXQkZmVydF9rZzIsIE5BKQpmaWVsZERhdCRmZXJ0X3RvdGFsXzIybnBrIDwtIGFwcGx5KGZpZWxkRGF0WywgZ3JlcCgiKDIybnBrLikiLCBuYW1lcyhmaWVsZERhdCkpXSwgMSwgZnVuY3Rpb24oeCl7CiAgc3VtKGFzLm51bWVyaWMoeCksIG5hLnJtPVQpfSkKCgoKZmllbGREYXQkZmVydF9rZ18yNTU1bnBrMSA8LSBpZmVsc2UoZmllbGREYXQkZmVydF90eXBlMT09Im5wazI1NTUiLCBmaWVsZERhdCRmZXJ0X2tnMSwgTkEpCmZpZWxkRGF0JGZlcnRfa2dfMjU1NW5wazIgPC0gaWZlbHNlKGZpZWxkRGF0JGZlcnRfdHlwZTI9PSJucGsyNTU1IiwgZmllbGREYXQkZmVydF9rZzIsIE5BKQpmaWVsZERhdCRmZXJ0X3RvdGFsXzI1NTVucGsgPC0gYXBwbHkoZmllbGREYXRbLCBncmVwKCIoMjU1NW5way4pIiwgbmFtZXMoZmllbGREYXQpKV0sIDEsIGZ1bmN0aW9uKHgpewogIHN1bShhcy5udW1lcmljKHgpLCBuYS5ybT1UKX0pCgoKI2xpbWUKZmllbGREYXQkbGltZV9vdXRzaWRlIDwtIGlmZWxzZShmaWVsZERhdCRkX2xpbWU9PSJsaW1lX291dHNpZGUiLCBmaWVsZERhdCRrZ19saW1lLCBOQSkKZmllbGREYXQkbGltZV90dWJ1cmEgPC0gaWZlbHNlKGZpZWxkRGF0JGRfbGltZT09ImxpbWVfdHVidXJhIiwgZmllbGREYXQka2dfbGltZSwgTkEpCmZpZWxkRGF0JGxpbWVfYm90aCA8LSBpZmVsc2UoZmllbGREYXQkZF9saW1lPT0iYm90aF90dWJ1cmFfbm9uX3R1YnVyYSIsIGZpZWxkRGF0JGtnX2xpbWUsIE5BKQoKaW5wdXRWYXJzIDwtIG5hbWVzKGZpZWxkRGF0KVtncmVwKCJmaWVsZF9sZW5ndGh8ZmllbGRfd2lkdGh8ZGltfGZlcnRfa2dffGZlcnRfdG90YWxffGxpbWVfIiwgbmFtZXMoZmllbGREYXQpKV0KCmZpZWxkRGF0WyxpbnB1dFZhcnNdIDwtc2FwcGx5KGZpZWxkRGF0WyxpbnB1dFZhcnNdLCBhcy5udW1lcmljKQoKCiN1cmVhCmZpZWxkRGF0JGZlcnRfa2dhcmVfdXJlYTEgPC0gZmllbGREYXQkZmVydF9rZ191cmVhMS9maWVsZERhdCRhcmUKZmllbGREYXQkZmVydF9rZ2FyZV91cmVhMiA8LSBmaWVsZERhdCRmZXJ0X2tnX3VyZWEyL2ZpZWxkRGF0JGFyZQpmaWVsZERhdCRmZXJ0X2tnYXJlX3VyZWFfdG90YWwgPC0gZmllbGREYXQkZmVydF90b3RhbF91cmVhL2ZpZWxkRGF0JGFyZQoKI2RhcApmaWVsZERhdCRmZXJ0X2tnYXJlX2RhcDEgPC0gZmllbGREYXQkZmVydF9rZ19kYXAxL2ZpZWxkRGF0JGFyZQpmaWVsZERhdCRmZXJ0X2tnYXJlX2RhcDIgPC0gZmllbGREYXQkZmVydF9rZ19kYXAyL2ZpZWxkRGF0JGFyZQpmaWVsZERhdCRmZXJ0X2tnYXJlX2RhcF90b3RhbCA8LSBmaWVsZERhdCRmZXJ0X3RvdGFsX2RhcC9maWVsZERhdCRhcmUKCiNucGsxNwpmaWVsZERhdCRmZXJ0X2tnYXJlXzE3bnBrMSA8LSBmaWVsZERhdCRmZXJ0X2tnXzE3bnBrMS9maWVsZERhdCRhcmUKZmllbGREYXQkZmVydF9rZ2FyZV8xN25wazIgPC0gZmllbGREYXQkZmVydF9rZ18xN25wazIvZmllbGREYXQkYXJlCmZpZWxkRGF0JGZlcnRfa2dhcmVfMTducGtfdG90YWwgPC0gZmllbGREYXQkZmVydF90b3RhbF8xN25way9maWVsZERhdCRhcmUKCiNucGsyMgpmaWVsZERhdCRmZXJ0X2tnYXJlXzIybnBrMSA8LSBmaWVsZERhdCRmZXJ0X2tnXzIybnBrMS9maWVsZERhdCRhcmUKZmllbGREYXQkZmVydF9rZ2FyZV8yMm5wazIgPC0gZmllbGREYXQkZmVydF9rZ18yMm5wazIvZmllbGREYXQkYXJlCmZpZWxkRGF0JGZlcnRfa2dhcmVfMjJucGtfdG90YWwgPC0gZmllbGREYXQkZmVydF90b3RhbF8yMm5way9maWVsZERhdCRhcmUKCiMyNTU1IG5wawpmaWVsZERhdCRmZXJ0X2tnYXJlXzI1NTVucGsxIDwtIGZpZWxkRGF0JGZlcnRfa2dfMjU1NW5wazEvZmllbGREYXQkYXJlCmZpZWxkRGF0JGZlcnRfa2dhcmVfMjU1NW5wazIgPC0gZmllbGREYXQkZmVydF9rZ18yNTU1bnBrMi9maWVsZERhdCRhcmUKZmllbGREYXQkZmVydF9rZ2FyZV8yNTU1bnBrX3RvdGFsIDwtIGZpZWxkRGF0JGZlcnRfdG90YWxfMjU1NW5way9maWVsZERhdCRhcmUKYGBgCgojIyMgVmlzdWFsaXplIGZpZWxkIHZhcmlhYmxlcwoKYGBge3J9CmZpZWxkSW5wdXRWYXJzIDwtIG5hbWVzKGZpZWxkRGF0KVtncmVwKCJmaWVsZF9sZW5ndGh8ZmllbGRfd2lkdGh8ZGltfGZlcnRfa2dhcmVfIiwgbmFtZXMoZmllbGREYXQpKV0KCgpmb3IoaSBpbiAxOmxlbmd0aChmaWVsZElucHV0VmFycykpewogICAgYmFzZSA8LSBnZ3Bsb3QoZmllbGREYXQsIGFlcyh4PWZpZWxkRGF0WyxmaWVsZElucHV0VmFyc1tpXV0pKSArIGxhYnMoeCA9IGZpZWxkSW5wdXRWYXJzW2ldLCB0aXRsZT1maWVsZElucHV0VmFyc1tpXSkKICAgIHRlbXAxIDwtIGJhc2UgKyBnZW9tX2RlbnNpdHkoKQogICAgdGVtcDIgPC0gYmFzZSArIGdlb21faGlzdG9ncmFtKCkKICAgICN0ZW1wMiA8LSBib3hwbG90KHJbLG51bVZhcnNbaV1dLG1haW49cGFzdGUwKCJWYXJpYWJsZTogIiwgbnVtVmFyc1tpXSkpCiAgICBtdWx0aXBsb3QodGVtcDEsIHRlbXAyLCBjb2xzID0gMikKfQpgYGAKClRPRE86IG1ha2UgY2VydGFpbiBJIGRvIHNvbWUgY2hlY2tpbmcgb2YgdGhlc2UgdmFsdWVzIGFib3ZlIGFuZCBpZiBub3QgYWJvdmUsIGhlcmUuCgpgYGB7cn0KIyBmaWVsZERhdCRzZWFzb25fMTZhIDwtIGlmZWxzZShncmVwbCgiMTZhIiwgZmllbGREYXQkbl90dWJ1cmFfc2Vhc29uKSwgMSwgMCkKIyBmaWVsZERhdCRzZWFzb25fMTZiIDwtIGlmZWxzZShncmVwbCgiMTZiIiwgZmllbGREYXQkbl90dWJ1cmFfc2Vhc29uKSwgMSwgMCkKIyBmaWVsZERhdCRzZWFzb25fMTdhIDwtIGlmZWxzZShncmVwbCgiMTdhIiwgZmllbGREYXQkbl90dWJ1cmFfc2Vhc29uKSwgMSwgMCkKIyBmaWVsZERhdCRub3RDbGllbnQzU2Vhc29ucyA8LSBpZmVsc2UoZ3JlcGwoIm5vdF9hX2NsaWVudCIsIGZpZWxkRGF0JG5fdHVidXJhX3NlYXNvbiksIDEsIDApCmBgYAoKQ2hlY2sgZmllbGQgZGltZW5zaW9uczoKCmBgYHtyfQpnZ3Bsb3QoZmllbGREYXQsIGFlcyh4PWZpZWxkX3dpZHRoLCB5PWZpZWxkX2xlbmd0aCkpICsgCiAgZ2VvbV9wb2ludCgpICsKICBsYWJzKHRpdGxlPSAiRmllbGQgZGltZW5zaW9ucyIsIHggPSAiV2lkdGggKG0pIiwgeT0gIkxlbmd0aCAobSkiKQpgYGAKCiMjIE1hcCBvZiBzYW1wbGVzCgpgYGB7cn0KbGlicmFyeShkaXNtbykKaWYgKCEoZXhpc3RzKCJyd2FuZGEiKSkpewogICMgT25seSBuZWVkIHRvIGdlb2NvZGUgb25jZSBwZXIgc2Vzc2lvbiBsaWJyYXJ5KGRpc21vKQogIHJ3YW5kYSA8LSB0cnkoZ2VvY29kZSgiUndhbmRhIikpCiAgIyBJZiB0aGUgaW50ZXJuZXQgZmFpbHMsIHVzZSBhIGxvY2FsIHZhbHVlIAogIGlmIChjbGFzcyhyd2FuZGEpID09ICJ0cnktZXJyb3IiKSB7CiAgICByd2FuZGEgPC0gIiIKICAgICMgYXJ1c2hhJGxvbmdpdHVkZSA8LSAzNi42ODI5OQogICAgIyBhcnVzaGEkbGF0aXR1ZGUgPC0gLTMuMzg2OTI1CiAgfSAKfQpgYGAKClNlZSBbaGVyZV0oaHR0cDovL3JzdHVkaW8tcHVicy1zdGF0aWMuczMuYW1hem9uYXdzLmNvbS8yMDg5OThfMzU5MmQzYzZhYzlhNDdjY2JmM2EzOTk3ZWMyYjY4ZWMuaHRtbCkgZm9yIG1vcmUgb24gdXNpbmcgbWFya2VyQ2x1c3Rlck9wdGlvbnMgaW4gbGVhZmxldC4KCkluIHRoZSBtYXAgYmVsb3csIHRoZSBsYXJnZXIgZ3JlZW4gY2lyY2xlcyBhcmUgVHVidXJhIGZhcm1lcnMgYW5kIHRoZSBzbWFsbGVyIGJsdWUgY2lyY2xlcyBhcmUgY29udHJvbCBmYXJtZXJzLiAqKlRoZSBudW1iZXIgb2Ygb2JzZXJ2YXRpb25zIHdpbGwgYXBwZWFyIGxhcmdlciBvbiB0aGUgbWFwIGJlY2F1c2UgaXQncyBwbG90IGxldmVsIGluc3RlYWQgb2YgZmFybWVyIGxldmVsLioqCgpgYGB7ciBsZWFmbGV0LCBmaWcud2lkdGg9OSwgZmlnLmhlaWdodD03fQplIDwtIHJzWyFpcy5uYShycyRsb24pLF0Kc3MgPC0gU3BhdGlhbFBvaW50c0RhdGFGcmFtZShjb29yZHMgPSBlWywgYygibG9uIiwgImxhdCIpXSwgZGF0YT1lKQoKcGFsIDwtIGNvbG9yTnVtZXJpYyhjKCJuYXZ5IiwgImdyZWVuIiksIGRvbWFpbj11bmlxdWUoc3MkY2xpZW50KSkKbWFwIDwtIGxlYWZsZXQoKSAlPiUgYWRkVGlsZXMoKSAlPiUKICBzZXRWaWV3KGxuZz1yd2FuZGEkbG9uZ2l0dWRlLCBsYXQ9cndhbmRhJGxhdGl0dWRlLCB6b29tPTgpICU+JQogIGFkZENpcmNsZU1hcmtlcnMobG5nPXNzJGxvbiwgbGF0PXNzJGxhdCwgCiAgICAgICAgICAgICAgICAgICByYWRpdXM9IGlmZWxzZShzcyRjbGllbnQ9PTEsIDEwLDYpLAogICAgICAgICAgICAgICAgICAgY29sb3IgPSBwYWwoc3MkY2xpZW50KSwKY2x1c3Rlck9wdGlvbnMgPSBtYXJrZXJDbHVzdGVyT3B0aW9ucyhkaXNhYmxlQ2x1c3RlcmluZ0F0Wm9vbT0xMywgc3BpZGVyZnlPbk1heFpvb209RkFMU0UpKQoKbWFwCmBgYAoKIyMgTGVzc29ucyBmb3IgTmF0aGFuaWVsCgpIZXJlIGFyZSB0aGUga2V5IHBpZWNlcyBvZiBmZWVkYmFjayBmb3IgdGhlIG5leHQgc3VydmV5IHJvdW5kOgoKKiBWYXJpYWJsZSBuYW1pbmcgY29udmVudGlvbiAtIHF1aXRlIGEgYml0IG9mIHdvcmsgaGFkIHRvIGJlIGRvbmUgdG8gd29yayB3aXRoIHRoZSBkYXRhLiBBbnkgcGxvdCBzcGVjaWZpYyB2YXJpYWJsZSBzaG91bGQgYmUgbmFtZWQgd2l0aCBfKHllYXIpKHNlYXNvbikgYXQgdGhlIGVuZC4gVGhpcyB3aWxsIG1ha2UgaXQgZWFzeSB0byByZXNoYXBlIHRob3NlIHZhcmlhYmxlcyBpbnRvIHBsb3QgbGV2ZWwgdmFyaWFibGVzLgoqIENoZWNrIHZhcmlhYmxlcyAtIHNvbWUgb2YgdGhlIGlucHV0IHZhcmlhYmxlcyBhcmUgcXVpdGUgbGFyZ2UuIElzIGl0IHBvc3NpYmxlIHRvIGhhdmUgQ0MgYXV0b21hdGljYWxseSBjYWxjdWxhdGUgcXVhbnRpdGllcyBpbiBhIHBlciBhcmUgcmF0ZSBhbmQgc2lnbmFsIHRoZSBlbnVtZXJhdG9yIGlmIHRoZSB2YWx1ZXMgc2VlbSBoaWdoPyBCZXR0ZXIgZmllbGQgZXN0aW1hdGVzIHNob3VsZCBoZWxwIHdpdGggdGhpcyBidXQgdGhhdCBzb3J0IG9mIGNoZWNrIHdvdWxkIGJlIGEgZ29vZCByZWFsaXR5IGNoZWNrIGluIHRoZSBmaWVsZC4KKiBTb2lsIHRleHR1cmluZyAtIGhvdyBsb25nIGRpZCB0aGlzIHRha2U/IEkgdGhpbmsgd2UgY2FuIGhhdmUgdGhpcyBkb25lIGluIHRoZSBsYWIKKiBTZWVkIHR5cGVzIC0gbm90IG1hbnkgZmFybWVycyByZXNwb25kZWQgdG8gdGhlIHNlZWQgdHlwZSBxdWVzdGlvbi4gRG8gd2UgaGF2ZSBhIHJlYXNvbiB3aHkgZnJvbSBlaXRoZXIgZmFybWVycyBvciBlbnVtZXJhdG9ycz8gCiogTkFzIC0gc28gbWFueSBOQXMgaW4gdGhlIGRhdGEhIFdoeT8KKiBUaW1pbmcgZm9yIHVwY29taW5nIHN1cnZleQoqICoqQ29tbWNhcmUqKjogUGxlYXNlIGVuc3VyZSB0aGF0IHRoZSB2YXJpYWJsZSBsYWJlbHMgYXJlIGluIHRoZSByaWdodCBsYW5ndWFnZSBib3guIFRoZSBleHBvcnQgSSdtIGdldHRpbmcgZGlyZWN0bHkgZnJvbSBDb21tY2FyZSBpcyBhIG1peCBvZiBFbmdsaXNoIGFuZCBLaW55YXJ3YW5kYSBuYW1lcy4gSSBhc3N1bWUgdGhhdCdzIGJlY2F1c2UgdGhlIGxhYmVscyB3ZXJlIG5vdCBpbiB0aGUgcmlnaHQgYm94ZXMuCgoKQW5hbHlzaXMgVE9ETzoKKiBmZWF0dXJlIGNyZWF0aW9uIChpbiBwcm9jZXNzKQoqIG1hdGNoaW5nICh0YWxrIHRvIE1heWEpCiAgKyAKKiBmb2xsb3dpbmcgcHJldmlvdXMgdGVtcGxhdGUgKGxvb2sgYmFjaykKICArIAoKRm9yIG5leHQgd2VlazoKKiB0YWxrIHdpdGggTWF5YSBhYm91dCBtYXRjaGluZyBsb25naXR1ZGluYWxseQoqIHNvaWwgZ3JhcGhzCgojIEFuYWx5c2lzCgpTYW1lIGFzIHRoZSBiYXNlbGluZSBhbmFseXNpcyBidXQgd2l0aCB0d28gc2Vhc29ucyBvZiBkYXRhCgpUT0RPOiBjb25maXJtIHRoYXQgYGRfY2xpZW50YCBpcyByZWZsZWN0aW5nIHRoZSByaWdodCBzdGF0dXMgYXMgYSBmYXJtZXIgaW4gdGhlIGRhdGEuIElzIGl0IGJhc2VsaW5lPyBJcyBpdCByb3VuZCAxPyBJcyBpdCBhIGNvbWJvIG9mIHRoZSB0d28/CgojIyBJZGVudGlmaWVyIHZhcmlhYmxlcwoKQ3JlYXRlIGEgcmVjb3JkIG9mIGhvdyBtYW55IGZhcm1lcnMgYXJlIGpvaW5pbmcgYW5kIGxlYXZpbmcgVHVidXJhIGJldHdlZW4gdGhlIGJhc2VsaW5lIGFuZCB0aGUgZmlyc3QgZm9sbG93IHVwIHJvdW5kLgoKYGBge3J9CiN0YWJsZShmaWVsZERhdCRkX2NsaWVudCwgZmllbGREYXQkc2Vhc29uKQpmaWVsZERhdCAlPiUgCiAgZHBseXI6OnNlbGVjdChzYW1wbGVfaWQsIHNlYXNvbiwgZF9jbGllbnQpICU+JQogIGdyb3VwX2J5KHNhbXBsZV9pZCkgJT4lCiAgc3ByZWFkKC4sIHNlYXNvbiwgZF9jbGllbnQpICU+JQogIHJlbmFtZSgKICAgIGNsaWVudDE1YiA9IGAxNWJgLAogICAgY2xpZW50MTZhID0gYDE2YWAsCiAgICBjbGllbnQxNmIgPSBgMTZiYAogICkgJT4lCiAgbXV0YXRlKAogICAgYmVjYW1lQ2xpZW50ID0gaWZlbHNlKGNsaWVudDE1Yj09MCAmIGNsaWVudDE2Yj09MSwgMSwgMCksCiAgICBiZWNhbWVDb250cm9sID0gaWZlbHNlKGNsaWVudDE1Yj09MSAmIGNsaWVudDE2Yj09MCwgMSwgMCksCiAgICBzdGF5ZWRDbGllbnQgPSBpZmVsc2UoY2xpZW50MTViPT0xICYgY2xpZW50MTZiPT0xLCAxLCAwKSwKICAgIHN0YXllZENvbnRyb2wgPSBpZmVsc2UoY2xpZW50MTViPT0wICYgY2xpZW50MTZiPT0wLCAxLCAwKQogICkgJT4lIAogIHVuZ3JvdXAoKSAlPiUKICBkcGx5cjo6c3VtbWFyaXplX2VhY2goCiAgICBmdW5zKG1lYW49IG1lYW4oLiwgbmEucm09VCkpLCAtYyhzYW1wbGVfaWQsIGNsaWVudDE1YiwgY2xpZW50MTZhLCBjbGllbnQxNmIpCiAgKSAlPiUgCiAgbXV0YXRlX2VhY2goCiAgICBmdW5zKHBhc3RlMChyb3VuZCguLDIpKjEwMCwgIiUiKSkKICApICU+JQogIGthYmxlKGNhcHRpb249Ik1vdmVtZW50IGluIFNhbXBsZSIsIGZvcm1hdD0nbWFya2Rvd24nKQoKYGBgCgojIyMgQ2xpZW50IGNvdW50CmBgYHtyfQpjbGllbnRDb3VudCA8LSBmaWVsZERhdCAlPiUgCiAgZHBseXI6OnNlbGVjdChzYW1wbGVfaWQsIHNlYXNvbiwgZF9jbGllbnQpICU+JQogIGdyb3VwX2J5KHNhbXBsZV9pZCkgJT4lCiAgc3ByZWFkKC4sIHNlYXNvbiwgZF9jbGllbnQpICU+JQogIHJlbmFtZSgKICAgIGNsaWVudDE1YiA9IGAxNWJgLAogICAgY2xpZW50MTZhID0gYDE2YWAsCiAgICBjbGllbnQxNmIgPSBgMTZiYAogICkKCgpjbGllbnRDb3VudFRhYiA8LSBjYmluZCgKICBhcy5kYXRhLmZyYW1lKHRhYmxlKGNsaWVudENvdW50JGNsaWVudDE1YikpLAogIGFzLmRhdGEuZnJhbWUodGFibGUoY2xpZW50Q291bnQkY2xpZW50MTZiKSkpCgpjbGllbnRDb3VudFRhYiA8LSBjbGllbnRDb3VudFRhYlssLTNdCm5hbWVzKGNsaWVudENvdW50VGFiKSA8LSBjKCJUcmVhdG1lbnQiLCAiQ2xpZW50cyAxNWIiLCAiQ2xpZW50cyAxNmIiKQp3cml0ZS5jc3YoY2xpZW50Q291bnRUYWIsIGZpbGU9cGFzdGUwKCJvdXRwdXQvIiwgImNsaWVudENvdW50VGFiLmNzdiIpLCByb3cubmFtZXMgPSBGKQpgYGAKClN1YnNldCBvZiBmYXJtZXJzIHRoYXQga2VwdCBzdGF0dXMgZm9yIHNvaWwgcmVncmVzc2lvbiB0YWJsZS4gClRPRE8gLSBkZWNpZGUgaWYgdGhlIGFuYWx5c2VzIHRoYXQgZm9sbG93IG5lZWQgdG8gYmUgdHVybmVkIGludG8gZnVuY3Rpb25zIG9yIGlmIGl0J3Mgc3VmZmljaWVudCB0byBzZXQgdGhlIHNhbXBsZSBoZXJlIGFuZCB1c2UgdGhhdCBzYW1lIHNhbXBsZSBnb2luZyBmb3J3YXJkLgoKYGBge3J9CnNhbWVTdGF0dXNWZWMgPC0gc29pbERhdCAlPiUKICBkcGx5cjo6c2VsZWN0KHNhbXBsZV9pZCwgc2Vhc29uLCBkX2NsaWVudCkgJT4lCiAgZ3JvdXBfYnkoc2FtcGxlX2lkKSAlPiUKICBzcHJlYWQoLiwgc2Vhc29uLCBkX2NsaWVudCkgJT4lCiAgYXMuZGF0YS5mcmFtZSgpICU+JQogIG11dGF0ZSgKICAgIHNhbWUgPSBpZmVsc2UoYDE1YmA9PWAxNmJgLCAxLCAwKQogICkgJT4lCiAgZmlsdGVyKHNhbWU9PTEpCgpzYW1lU3RhdHVzIDwtIHNvaWxEYXRbc29pbERhdCRzYW1wbGVfaWQgJWluJSBzYW1lU3RhdHVzVmVjJHNhbXBsZV9pZCxdCnNhbWVTdGF0dXNDb3VudCA8LSB0YWJsZShzYW1lU3RhdHVzJGRfY2xpZW50KS8yCndyaXRlLmNzdihzYW1lU3RhdHVzQ291bnQsIGZpbGU9Im91dHB1dC9zYW1lU3RhdHVzQ291bnQuY3N2IikKI3NhbWVTdGF0dXNmcyA8LSBzb2lsRGF0W3NvaWxEYXQkc2FtcGxlX2lkICVpbiUgc2FtZVN0YXR1c1ZlYyRzYW1wbGVfaWQsXSAjCmBgYAoKIyMgRGVtb2dyYXBoaWMgc3VtbWFyeQoKIyMgU29pbCBzdW1tYXJ5CgojIyMgSW5pdGlhbCBzb2lsIGdyYXBocwoKVGhlc2UgZ3JhcGhzIGFyZSBhIHBlZWsgYXQgaG93IHNvaWwgcGFyYW1ldGVyIGF2ZXJhZ2VzIGFuZCBkaWZmZXJlbmNlcyBsb29rIGJldHdlZW4gdHJlYXRtZW50IGFuZCBjb250cm9sIGZhcm1lcnMgdXNpbmcgYm90aCBiYXNlbGluZSBhbmQgcm91bmQgMSB2YWx1ZXMuICoqVGhpcyBpcyBhIHByZWxpbWluYXJ5IHJvdWdoIGxvb2sqKi4gTmV4dCBzdGVwcyBpbmNsdWRlOgoKKiBDb25maXJtaW5nIGNsaWVudCBhc3NpZ25tZW50IGFuZCBjbGFyaWZ5aW5nIHN0YXR1cwoqIEFkZGl0aW9uYWwgY2xlYW5pbmcgb2Ygc29pbCB2YXJpYWJsZXMKICArIHJlY29uY2lsZSB1c2luZyBJUVIgb3IgU0QgbWV0aG9kIGZvciBhZGp1c3RpbmcgZGF0YQoqIE1hdGNoaW5nIG9mIGNsaWVudHMgdG8gZGVyaXZlIGEgbW9yZSBjYXVzYWwgbG9vayBhdCBjbGllbnQgZWZmZWN0cyBvbiBzb2lsIHBhcmFtZXRlcnMuCgpbSGVscGZ1bCBjb2RlIGZvciBwdXR0aW5nIHRoZSBncmFwaGljcyB0b2dldGhlcl0oaHR0cHM6Ly9naXRodWIuY29tL3RpZHl2ZXJzZS9nZ3Bsb3QyL3dpa2kvTWl4aW5nLWdncGxvdDItZ3JhcGhzLXdpdGgtb3RoZXItZ3JhcGhpY2FsLW91dHB1dCkKCiMjIyBTb2lsIG1lYW5zIGFuZCBkaWZmcwoKVE9ETzogQ2xlYW4gc29pbCBkYXRhIGhlcmUgb25jZSBTdGVwIGFuZCBQYXRyaWNrIGhhdmUgc29tZSBmZWVkYmFjayByZWdhcmRpbmcgd2hhdCBhcmUgcmVhc29uYWJsZSBhbmQgdW5yZWFzb25hYmxlIHZhbHVlcy4KCmBzb2lsT3V0YCBoYXMgY29tbW9uIG1vZGlmaWNhdGlvbnMuIEFsbCByZXN1bHRpbmcgc29pbCBvdXRjb21lcyBhcmUgbWFkZSB1c2luZyB0aGF0LiBTb2lsIG91dGNvbWVzIGFyZSBuYW1lZCBgc29pbE91dC5vdXRjb21lX25hbWVgLiBUaGlzIHVzZXMgb25seSBmYXJtZXJzIHRoYXQgaGF2ZSB0aGUgc2FtZSB0cmVhdG1lbnQgc3RhdHVzIGluIDE1YiBhbmQgMTZiCgpgYGB7cn0Kc29pbE91dCA8LSBzb2lsRGF0ICU+JSAKICBmaWx0ZXIoc29pbERhdCRzYW1wbGVfaWQgJWluJSBzYW1lU3RhdHVzVmVjJHNhbXBsZV9pZCkgJT4lCiAgbXV0YXRlKAogIG1lYXN1cmUgPSBpZmVsc2Uoc2Vhc29uPT0iMTViIiwgMSwgCiAgICAgICAgICAgICAgICAgICBpZmVsc2Uoc2Vhc29uPT0iMTZiIiwgMixOQSkpCikgJT4lIGFycmFuZ2UobWVhc3VyZSkgJT4lCiAgYXMuZGF0YS5mcmFtZSgpCgpzb2lsT3V0Lk1lYW4gPC0gc29pbE91dCAlPiUKICBncm91cF9ieShzYW1wbGVfaWQpICU+JQogIHN1bW1hcml6ZV9lYWNoKAogICAgZnVucyhtZWFuKC4sIG5hLnJtPVQpKSwgLWMoU1NOLCBzZWFzb24sIHNhbXBsZV9pZCwgbWVhc3VyZSwgZF9jbGllbnQpCiAgKSAlPiUgCiAgdW5ncm91cCgpICU+JSAKICBhcy5kYXRhLmZyYW1lKCkgJT4lCiAgcmVuYW1lXyguZG90cyA9IHNldE5hbWVzKG5hbWVzKC4pLCBnc3ViKCJYXFwufFxcLiIsICIiLCBuYW1lcyguKSkpKQoKIyBmaW5kIGEgd2F5IHRvIGZpdCB0aGlzIGludG8gcGlwaW5nCm5hbWVzKHNvaWxPdXQuTWVhbilbMjoxOV0gPC0gcGFzdGUwKG5hbWVzKHNvaWxPdXQuTWVhbilbMjoxOV0sICIubWVhbiIpCgojIDBzIGFyZSB3aGVuIHdlIGhhdmUgb25seSBvbmUgb2JzZXJ2YXRpb24Kc29pbE91dC5EaWZmIDwtIHNvaWxPdXQgJT4lCiAgZ3JvdXBfYnkoc2FtcGxlX2lkKSAlPiUKICAjIHN1bW1hcmlzZV9lYWNoKAogICMgICBmdW5zKGlmX2Vsc2UobGVuZ3RoKC4pPT0yLCBkaWZmKHgpLCAuKSksIC1jKFNTTiwgc2Vhc29uLCBzYW1wbGVfaWQsIG1lYXN1cmUpCiAgIyApICU+JSB1bmdyb3VwKCkgJT4lIGFzLmRhdGEuZnJhbWUoKQogIG11dGF0ZV9lYWNoKAogICAgZnVucyguIC0gbGFnKC4sIGRlZmF1bHQ9Zmlyc3QoLikpKSwgLWMoU1NOLCBzZWFzb24sIHNhbXBsZV9pZCwgbWVhc3VyZSwgZF9jbGllbnQpCiAgKSAlPiUKICBmaWx0ZXIobWVhc3VyZT09MikgJT4lCiAgYXMuZGF0YS5mcmFtZSgpICU+JQogIHJlbmFtZV8oLmRvdHMgPSBzZXROYW1lcyhuYW1lcyguKSwgZ3N1YigiWFxcLnxcXC4iLCAiIiwgbmFtZXMoLikpKSkKCiMgZmluZCBhIHdheSB0byBmaXQgdGhpcyBpbnRvIHBpcGluZwpuYW1lcyhzb2lsT3V0LkRpZmYpWzE6MThdIDwtIHBhc3RlMChuYW1lcyhzb2lsT3V0LkRpZmYpWzE6MThdLCAiLmRpZmYiKQoKCiMgZ2F0aGVyIHNvaWwgb3V0Y29tZXMgdG8gbWVyZ2UgYmFjayB0b2dldGhlcgojc29pbFRyYW5zIDwtIGxpc3QobHMoKVtncmVwKCJzb2lsT3V0LiIsIGxzKCkpXSkKCnNvaWxNZXJnZSA8LSBtZXJnZShzb2lsT3V0Lk1lYW4sIHNvaWxPdXQuRGlmZixieT0ic2FtcGxlX2lkIikKCgpsaWJyYXJ5KHRpZHlyKQpsaWJyYXJ5KFJHcmFwaGljcykKc29pbEdyYXBoIDwtIHNvaWxNZXJnZSAlPiUKICBnYXRoZXIodmFyaWFibGUsIHZhbHVlLCAtYyhTU04sIHNhbXBsZV9pZCwgbWVhc3VyZSwgc2Vhc29uLCBkX2NsaWVudCkpICU+JQogIHNlcGFyYXRlKHZhcmlhYmxlLCBjKCJzb2lsQ2hhciIsICJ0eXBlIiksIHNlcD0iXFwuIikKCmZvcihpIGluIDE6bGVuZ3RoKHVuaXF1ZShzb2lsR3JhcGgkc29pbENoYXIpKSl7CiAgZm9yKGogaW4gMTpsZW5ndGgodW5pcXVlKHNvaWxHcmFwaCR0eXBlKSkpewogICAgCiAgICB0ZW1wIDwtIHNvaWxHcmFwaCAlPiUgCiAgICAgIGZpbHRlcihzb2lsQ2hhcj09dW5pcXVlKHNvaWxHcmFwaCRzb2lsQ2hhcilbaV0gJiBzb2lsR3JhcGgkdHlwZT09dW5pcXVlKHNvaWxHcmFwaCR0eXBlKVtqXSkgJT4lCiAgICAgIG11dGF0ZSgKICAgICAgICB2YWx1ZSA9IGlmZWxzZShpcy5pbmZpbml0ZSh2YWx1ZSksIE5BLCB2YWx1ZSkKICAgICAgKQogICAgCiAgICAKICAgICBncGggPSBnZ3Bsb3QodGVtcCwgYWVzKHggPSBkX2NsaWVudCwgeT12YWx1ZSkpICsgCiAgICAgICBnZW9tX2JveHBsb3QoKSArIAogICAgICAgbGFicyh0aXRsZSA9IHBhc3RlKCJOT04tTUFUQ0hFRCBQUkVMSU0gLSIsIHVuaXF1ZShzb2lsR3JhcGgkc29pbENoYXIpW2ldLCB1bmlxdWUoc29pbEdyYXBoJHR5cGUpW2pdLCBzZXA9IiAiKSwgeCA9ICJUcmVhdG1lbnQgdi4gQ29udHJvbCIsIHk9dW5pcXVlKHNvaWxHcmFwaCRzb2lsQ2hhcilbaV0pCiAgICAKICAgIAogICAgCiAgICAgIHRhYiA9IHRhYmxlR3JvYigKICAgICAgICBhZ2dyZWdhdGUodGVtcCR2YWx1ZSwgYnk9bGlzdCh0ZW1wJGRfY2xpZW50KSwgZnVuY3Rpb24oeCl7CiAgICAgICAgcGFzdGUocm91bmQobWVhbih4LCBuYS5ybT1UKSwyKSwgIiAoIiwgcm91bmQoc2QoeCxuYS5ybT1UKSwyKSwgIikiLCBzZXA9IiIpCiAgICAgICAgICB9KSwKICAgICAgICBjb2xzID0gYygiVHJlYXRtZW50IiwgIk1lYW4gKHNkKSIpKQogICAgICAKCiAgICAgIGdyaWQuYXJyYW5nZShncGgsIHRhYiwgbmNvbD0yLCB0b3A9cGFzdGUoIk5PTi1NQVRDSEVEIFBSRUxJTSAtIiwgdW5pcXVlKHRlbXAkc29pbENoYXIpLCB1bmlxdWUodGVtcCR0eXBlKSwgc2VwPSIgIikpCgogIH0KfQoKCmBgYAoKIyMjIFNvaWwgc3VtbWFyeSB0YWJsZQoKKipOb3RlKio6IFRoaXMgdGFibGUgaXMgcHJlbGltaW5hcnkgYW5kIGRvZXMgbm90IHJlZmxlY3QgdmFsdWVzIHJlYWR5IGZvciBpbnRlcnByZXRhdGlvbiAoNi8xOSkuIFRoaXMgdXNlcyAqKmFsbCBmYXJtZXJzKiouCgpgYGB7cn0KdGFiT3V0IDwtIGRvLmNhbGwocmJpbmQsIGxhcHBseShzcGxpdChzb2lsR3JhcGgsIGxpc3Qoc29pbEdyYXBoJHR5cGUsIHNvaWxHcmFwaCRzb2lsQ2hhcikpLCBmdW5jdGlvbih4KXsKICAKICB4IDwtIHggJT4lIG11dGF0ZSgKICAgdmFsdWUgPSBpZmVsc2UoaXMuaW5maW5pdGUodmFsdWUpLCBOQSwgdmFsdWUpIAogICkKICAKICB0ZW1wID0gYWdncmVnYXRlKHgkdmFsdWUsIGJ5PWxpc3QoeCRkX2NsaWVudCksIEZVTj1tZWFuLCBuYS5ybT1UKQogIHB2YWwgPSByb3VuZCh3aWxjb3gudGVzdCh2YWx1ZSB+IGRfY2xpZW50LCBkYXRhPXgpJHAudmFsdWUsMykKICBUbWVhbiA9IHJvdW5kKHRlbXAkeFsyXSwgMikKICBDbWVhbiA9IHJvdW5kKHRlbXAkeFsxXSwgMikKICAKICBvdXRwdXQgPSBkYXRhLmZyYW1lKGNhdCA9IHBhc3RlMCh1bmlxdWUoeCRzb2lsQ2hhciksICIgLSAiLCB1bmlxdWUoeCR0eXBlKSksIENtZWFuLCBUbWVhbiwgcHZhbCkKICByZXR1cm4ob3V0cHV0KQogIAp9KSkKCnRhYk91dCA8LSB0YWJPdXQgJT4lIAogIG11dGF0ZShwdmFsLmFkaiA9IHJvdW5kKHAuYWRqdXN0KHB2YWwsICJmZHIiKSwzKSkgJT4lCiAgYXJyYW5nZShwdmFsLmFkaikKCmthYmxlKHRhYk91dCwgZm9ybWF0PSdtYXJrZG93bicsIHJvdy5uYW1lcyA9IEYsIGNvbC5uYW1lcyA9IGMoIk91dGNvbWUiLCAiQ29udHJvbCBtZWFuIiwgIk9BRiBtZWFuIiwgInAtdmFsdWUiLCAiYWRqLiBwLXZhbHVlIikpCmBgYAoKIyMjIExvbmdpdHVkaW5hbCBzb2lsIGdyYXBocwoKYGBge3J9CnNvaWxMaW5lR3JhcGggPC0gc29pbE91dCAlPiUKICBncm91cF9ieShkX2NsaWVudCwgc2Vhc29uKSAlPiUKICBzdW1tYXJpemVfZWFjaCgKICAgIGZ1bnMobWVhbiguLCBuYS5ybT1UKSksIC1jKFNTTiwgc2FtcGxlX2lkKQogICkgJT4lCiAgZ2F0aGVyKHZhcmlhYmxlLCB2YWx1ZSwgLWMoc2Vhc29uLCBkX2NsaWVudCkpICU+JQogIGZpbHRlcih2YXJpYWJsZSAlaW4lIGtleVNvaWxWYXJzKQogIApwZGYoZmlsZT1wYXN0ZSgib3V0cHV0LyIsICJrZXkgc29pbCB2YXJzIC0gbG9uZ2l0dWRpbmFsLnBkZiIsIHNlcCA9ICIiKSwgd2lkdGg9MTEsIGhlaWdodD04LjUpCmZvcihpIGluIDE6bGVuZ3RoKGtleVNvaWxWYXJzKSl7CiAgICBwcmludChnZ3Bsb3Qoc3Vic2V0KHNvaWxMaW5lR3JhcGgsIHNvaWxMaW5lR3JhcGgkdmFyaWFibGU9PWtleVNvaWxWYXJzW2ldKSwgYWVzKHggPSBzZWFzb24sIHkgPSB2YWx1ZSwgZ3JvdXA9ZF9jbGllbnQsIGNvbG9yPWRfY2xpZW50KSkgKyAKICAgICAgZ2VvbV9saW5lKCkgKwogICAgICBsYWJzKHRpdGxlPXBhc3RlKGtleVNvaWxWYXJzW2ldLCAib3ZlciB0aW1lIGJ5IGNsaWVudCBzdGF0dXMgLSBzYW1lIG9ubHkiLCBzZXA9ICIgIiksCiAgICAgICAgICB4PSAiU2Vhc29uIiwgeT1rZXlTb2lsVmFyc1tpXSwgY29sb3I9IlRyZWF0bWVudCIpCiAgICApCiAgbWFrZUZvb3Rub3RlKGZvb3Rub3RlKQogICAgCn0KZGV2Lm9mZigpCmBgYAoKSGVyZSBpcyB0aGUgdGFibGUgaW4gc2VjdGlvbiAxIG9mIHRoZSByZXBvcnQuIAoKYGBge3J9CnNvaWxMaW5lR3JhcGggJT4lCiAgc3ByZWFkKHNlYXNvbiwgdmFsdWUpICU+JQogIGFycmFuZ2UodmFyaWFibGUpICU+JQogIHJlbmFtZSgKICAgIHllYXIxID0gYDE1YmAsCiAgICB5ZWFyMiA9IGAxNmJgCiAgKSAlPiUKICBtdXRhdGVfaWYoCiAgICBpcy5udW1lcmljLCBmdW5zKHJvdW5kKC4sMykpCiAgKSAlPiUgCiAgd3JpdGUuY3N2KC4sIGZpbGU9Im91dHB1dC9zdW1UYWIxLmNzdiIpCgpgYGAKCgojIyMgSW5pdGlhbCByZWdyZXNzaW9ucwoKU2VlIFtza2V0Y2ggb2YgU0hTIHJlcG9ydF0oaHR0cHM6Ly9kb2NzLmdvb2dsZS5jb20vZG9jdW1lbnQvZC8xa29Oc0t6eDk3XzNycGtHZUpJNlBuUGRZTk1kVjlxNGUtY1BReEFXRGVEay9lZGl0KS4gIFJlbWVtYmVyIHRoYXQgYHNhbWVTdGF0dXNgIGFyZSB0aGUgZmFybWVycyB0aGF0IGtlcHQgdGhlaXIgc3RhdHVzIGJldHdlZW4gYmFzZWxpbmUgYW5kIGVuZGxpbmUuIFRoZSB0d28gbW9kZWxzIG9mIGludGVyZXN0IGFyZToKCiogQ2xpZW50IFkwIHZzLiBjbGllbnQgWTEKKiBDbGllbnQgWTEgdnMuIG5vbi1jbGllbnQgWTEKClRPRE8gLSBmb2xsb3cgdXAgd2l0aCBNYXlhIGFib3V0IGhvdyB0byBtYXRjaCBvdmVyIHRpbWUgb3IgaWYgdGhlcmUncyBhIGJldHRlciBpbmZlcmVuY2Ugc3RyYXRlZ3kuCgpgYGB7cn0KY2x1c3Quc2UgPC0gZnVuY3Rpb24obW9kLCBjbHVzKSB7CiAgICAgICAgIyBiYXNpYyBwYXJhbWV0ZXJzCiAgICAgICAgbSA8LSBsZW5ndGgoY2x1cykKICAgICAgICBuIDwtIGxlbmd0aCh1bmlxdWUoY2x1cykpCiAgICAgICAgayA8LSBtb2QkcmFuawogICAgICAgIGRmIDwtIChuIC8gKG4gLSAxKSkgKiAoKG0gLSAxKSAvIChtIC0gaykpCiAgICAgICAgIyBjYWxjdWxhdGUgb3VyIHN1bW1lZCBlcnJvciB0ZXJtcwp1IDwtIGFwcGx5KGVzdGZ1bihtb2QpLCAyLCBmdW5jdGlvbih4KSB7dGFwcGx5KHgsIGNsdXMsIHN1bSl9KQogICAgICAgICMgY2FsY3VsYXRlIHZhci9jb3ZhciBtYXRyaXgKICAgICAgICBhbnMgPC0gZGYgKiBzYW5kd2ljaChtb2QsIG1lYXQgPSAodCh1KSAlKiUgdSkgLyBtKQpyZXR1cm4oYW5zKSAKfQoKI20xLmNsdXN0ZXIgPC0gY29lZnRlc3QobTEsIGNsdXN0LnNlKG0xLCBkJGNsdXN0ZXIpKQpgYGAKCmBgYHtyfQpsaWJyYXJ5KHNhbmR3aWNoKQpsaWJyYXJ5KGxtdGVzdCkKc291cmNlKCIuLi9vYWZsaWIvcGxtLlIiKQoKcmVnVmFycyA8LSBjKGtleVNvaWxWYXJzLCAic2FtcGxlX2lkIiwgImRfY2xpZW50IiwgInNlYXNvbiIsICJkaXN0cmljdCIpCgojIGZ1bmN0aW9uIHRvIGdldCBiYXNlbGluZSBjbGllbnQgdnMuIFkxIGNsaWVudCBmb3Igc3BlY2lmaWVkIHZhcmlhYmxlcwpiYXNlVnIxIDwtIGZ1bmN0aW9uKGRmLCB2YXJpYWJsZXMpIHsKIHJldHVybigKICAgZGYgPC0gZGYgJT4lCiAgICAgIGRwbHlyOjpzZWxlY3Qob25lX29mKHZhcmlhYmxlcykpICU+JQogICAgICBmaWx0ZXIoZF9jbGllbnQ9PTEpCiApCn0KCiMgZnVuY3Rpb24gdG8gZ2V0IHkxIGNsaWVudCB2cy4geTEgbm9uLWNsaWVudCBmb3Igc3BlY2lmaWVkIHZhcmlhYmxlcwpjbGllbnRWbm9uIDwtIGZ1bmN0aW9uKGRmLCB2YXJpYWJsZXMpeyAKICByZXR1cm4oCiAgIGRmIDwtIGRmICU+JQogICAgICBkcGx5cjo6c2VsZWN0KG9uZV9vZih2YXJpYWJsZXMpKSAlPiUKICAgICAgZmlsdGVyKHNlYXNvbj09IjE2YiIpCiApCn0gCgojIGFsbFJlZyBpcyBhbGwgb2JzZXJ2YXRpb25zLCBCUiBpcyBiYXNlbGluZSB2cy4gUjEsIENvIGlzIGNsaWVudCBvbmx5CnNhbWVSZWdCciA8LSBiYXNlVnIxKGZpZWxkU29pbERhdCwgcmVnVmFycykKCmJhc2VWcjFNb2QgPC0gZG8uY2FsbChyYmluZCwgbGFwcGx5KGtleVNvaWxWYXJzLCBmdW5jdGlvbih4KXsKICBtb2QgPSBwbG0obG0oYXMuZm9ybXVsYShzYW1lUmVnQnJbLHhdIH4gYXMuZmFjdG9yKHNlYXNvbikpLCBkYXRhPXNhbWVSZWdCciksICJzYW1wbGVfaWQiKQogICNtb2QgPSBsbShhcy5mb3JtdWxhKHNhbWVSZWdCclsseF0gfiBhcy5mYWN0b3Ioc2Vhc29uKSksIGRhdGE9c2FtZVJlZ0JyKQogICNtb2QuY2x1c3RlciA8LSBjb2VmdGVzdChtb2QsIGNsdXN0LnNlKG1vZCwgc2FtZVJlZ0JyJHNhbXBsZV9pZCkpCiAgCiAgcm93bmFtZXMobW9kKSA9IHBhc3RlKHJvd25hbWVzKG1vZCksIHgsICJzYW1lIiwgc2VwID0gIiAiKQogIAogIHJldHVybihtb2QpCn0pKQp3cml0ZS5jc3YoYmFzZVZyMU1vZCwgZmlsZT0ib3V0cHV0L2NsaWVudEJhc2VWUjEuY3N2IikKCgojIHNhbWVSZWcgaXMgb25seSBmYXJtZXJzIHRoYXQga2VwdCB0aGVpciBzdGF0dXMKc2FtZVJlZ0NvIDwtIGNsaWVudFZub24oZmllbGRTb2lsRGF0LCByZWdWYXJzKQojIG1vZGVscyBvZiBpbnRlcmVzdCBhcmUgYmFzZWxpbmUgdnMuIHJvdW5kIDEKIyBtb2RlbCAyIGlzIGNsaWVudCB2cy4gbm9uIGNsaWVudAoKY2xpZW50Vm5vbk1vZCA8LSBkby5jYWxsKHJiaW5kLCBsYXBwbHkoa2V5U29pbFZhcnMsIGZ1bmN0aW9uKHgpewogIG1vZCA9IHBsbShsbShhcy5mb3JtdWxhKHNhbWVSZWdDb1sseF0gfiBhcy5mYWN0b3IoZF9jbGllbnQpICsgYXMuZmFjdG9yKGRpc3RyaWN0KSksIGRhdGE9c2FtZVJlZ0NvKSwgImRpc3RyaWN0IikKICByb3duYW1lcyhtb2QpID0gcGFzdGUocm93bmFtZXMobW9kKSwgeCwgInNhbWUiLCBzZXAgPSAiICIpCiAgCiAgcmV0dXJuKG1vZCkKfSkpCndyaXRlLmNzdihjbGllbnRWbm9uTW9kLCBmaWxlPSJvdXRwdXQvY2xpZW50Vm5vbi5jc3YiKQpgYGAKCiogSW5kaXZpZHVhbCBmaXhlZCBlZmZlY3RzIGFjY291bnQgZm9yIHRoaW5ncyBzcGVjaWNpYyB0byBmYXJtZWVyIHRoYXQgZG9uJ3QgY2hhbmdlIG92ZXIgdGltZQoqIGNhbiBjb250cm9sIGZvciB1bm9ic2VydmVkIHNvdXJjZXMgb2YgaGV0ZXJvZ2VuZWl0eSBvdmVyIHRpbWUsIHZlcnkgc2Vuc2l0aXZlIHRvIG1vZGVsIAoqIGFkZCBpbiBvdGhlciBkYXRhIHBvaW50cyB0aGF0IGRvIGNoYW5nZSBvdmVyIHRpbWUKKiBzbyBhZGQgaW4gdGhpbmdzIHRoYXQgY2hhbmdlIG92ZXIgdGltZSB0aGF0IHBsYXVzaWJseSBhZmZlY3Qgb3VyIG91dGNvbWUKKiBmZXJ0aWxpemVyIGFuZCBzZWVkIHVzZSBhcmUgc3lub3ltb3VzIHdpdGggYmVpbmcgYSBjbGllbnQgb3Igbm90LCBoaWdobHkgZW5kb2dlbm91cwoqIHJ1biB0d28gcmVncwogKyBvbmUgd2l0aCBvYWYgCiArIG9uZSB3aXRoIG9hZiBhbmQgZmVydGlsaXplcgoqIHRoaW5ncyBsaWtlIHNsb3BlIGFyZSBjb2xsaW5lYXIKCiogaW5kaXZpZHVhbCBmaXhlZCBlZmZlY3RzIG1ha2VzIG1vcmUgc2Vuc2UgdGhhbiB1c2luZyBQU00gbm93IHRoYXQgd2UgaGF2ZSBtdWx0aXBsZSB5ZWFycy4KKiBtZWFucyBieSBkaXJlY3Rpb25hbCBjaGFuZ2VzCgoqIHBhcGVycyB1c2luZyBmaXhlZCBlZmZlY3RzIGJ5IG1pZ3VlbCBvbiB3aGV0aGVyIGNoYW5nZXMgdG8gcnVyYWwgdG8gdXJiYW4gYXJlYXMgYW5kIGluY29tZQoKYGBge3J9CmluZEZlIDwtIGRvLmNhbGwocmJpbmQsIGxhcHBseShrZXlTb2lsVmFycywgZnVuY3Rpb24oeCl7CiAgbW9kID0gcGxtKGxtKGFzLmZvcm11bGEoZmllbGRTb2lsRGF0Wyx4XSB+IGFzLmZhY3RvcihkX2NsaWVudCkgKyBhcy5mYWN0b3Ioc2FtcGxlX2lkKSArIGFzLmZhY3RvcihzZWFzb24pKSxkYXRhPWZpZWxkU29pbERhdCksIGMoInNhbXBsZV9pZCIsICJzZWFzb24iKSkKICAjbW9kID0gbG0oYXMuZm9ybXVsYShzYW1lUmVnQnJbLHhdIH4gYXMuZmFjdG9yKHNlYXNvbikpLCBkYXRhPXNhbWVSZWdCcikKICAjbW9kLmNsdXN0ZXIgPC0gY29lZnRlc3QobW9kLCBjbHVzdC5zZShtb2QsIHNhbWVSZWdCciRzYW1wbGVfaWQpKQogIAogIHJvd25hbWVzKG1vZCkgPSBwYXN0ZShyb3duYW1lcyhtb2QpLCB4LCBzZXAgPSAiICIpCiAgCiAgcmV0dXJuKG1vZCkKfSkpCndyaXRlLmNzdihpbmRGZSwgZmlsZT0ib3V0cHV0L2luZEZlLmNzdiIpCgoKYGBgCgpJbiB0aGUgaW5kaXZpZHVhbCBmaXhlZCBlZmZlY3QgbW9kZWwgYWJvdmUsIHRoZSBuYWl2ZSBtb2RlbCB3b3VsZCBvbmx5IGluY2x1ZGUgYSBjbGllbnQgaW5kaWNhdG9yIGFuZCBpbmRpdmlkdWFsIGZpeGVkIGVmZmVjdHMuIElmIHdlIGFkZCBzZWFzb24sIHdlIGxvc2Ugc2lnbmlmaWNhbmNlIG9uIGFsbW9zdCBldmVyeXRoaW5nLiBJJ2QgZ3Vlc3MgdGhhdCBhcyB3ZSBhZGQgbW9yZSBsaWtlbHkgY29udHJvbHMgd2UgYWRkaXRpb25hbGx5IGxvc2Ugc2lnbmZpY2FuY2UuIAoKYGBge3J9CmthYmxlKGluZEZlLCBmb3JtYXQ9Im1hcmtkb3duIikKYGBgCgoKIyBTdW1tYXJ5CgojIEFwcGVuZGl4CgoK